2021-02-10T23:33:19.190 INFO:root:teuthology version: 1.1.0-14fad317 2021-02-10T23:33:19.191 DEBUG:teuthology.run:Teuthology command: teuthology --name hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba --archive /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961 --description rbd:singleton/{all/admin_socket objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} --owner scheduled_hmunjulu@teuthology --verbose -- /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961/orig.config.yaml 2021-02-10T23:33:21.573 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-02-10T23:33:21.659 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961 branch: master description: rbd:singleton/{all/admin_socket objectstore/bluestore-bitmap openstack supported-random-distro$/{rhel_8}} email: null first_in_suite: false job_id: '5868961' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba name: hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: master ceph: conf: mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore create_rbd_pool: true fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: cephadm sha1: d2ee8f1c2f76677a4f3bb21611881adb033d0c00 owner: scheduled_hmunjulu@teuthology priority: 80 repo: https://github.com/ceph/ceph roles: - - mon.a - mgr.x - osd.0 - osd.1 - client.0 sha1: 83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 sleep_before_teardown: 0 suite: rbd:singleton suite_branch: cephadm suite_path: /home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa suite_relpath: qa suite_repo: https://github.com/harishmunjulur/ceph.git suite_sha1: d2ee8f1c2f76677a4f3bb21611881adb033d0c00 targets: gibba001.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0GIgz4DJNdVmyqmQw6MaZ/05BDRlou61L51vreA6DbTfzk14+ORWY4EyozijDpTF02kSVQVS/BF6Mw4ZvSCuZpPX4bJADr5ocbvwZpCNg5rPVosbXACvTqhKm4hqWCDDi5esKQLgeTii+AF68iOSMG5fVRQjKbyb6MnjtLVwmM1Ty4KJ20SJlmSi9JxRszFTi/qfDWbjIIe5885LbMHkajVF1YIGYwT+70N3RUxBW37MGQzDhwM4FH8XF7Yj0eeeXgy9xEK2Z7+alT03MiQrmvynp3GLePAWR4UVBZv/GT8HbByEq54nXpeLtlfkQCS81VinKxM69RVczTe3N81QfpJ4ndoCSpND6jWEEaZJKqpfvUXU4T2fuOVLV4zR78V4GwLMMfMG9zjJrn5vThYEaSQU3nU43syrlU0TOl2hsJFN7swRLchcZh/Nn209L8vkNMu/VWOnDBS+jgpPt2knriRB2gqs3uBfMuezyLQAlvUmcUa1GKGZkdXHM97tKa0s= tasks: - install: null - cephadm: fs: xfs - workunit: clients: all: - rbd/test_admin_socket.sh teuthology_branch: master timestamp: 2021-02-09_00:33:45 tube: gibba user: hmunjulu verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.29737 2021-02-10T23:33:21.659 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa; will attempt to use it 2021-02-10T23:33:21.669 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks 2021-02-10T23:33:21.670 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-02-10T23:33:21.678 INFO:teuthology.task.internal:Checking packages... 2021-02-10T23:33:21.740 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash '83d3ac1b03b4de4360f18a023c40ea1ae6fc3928' 2021-02-10T23:33:21.741 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-02-10T23:33:21.741 INFO:teuthology.packaging:ref: None 2021-02-10T23:33:21.741 INFO:teuthology.packaging:tag: None 2021-02-10T23:33:21.741 INFO:teuthology.packaging:branch: master 2021-02-10T23:33:21.741 INFO:teuthology.packaging:sha1: 83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 2021-02-10T23:33:21.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-02-10T23:33:22.623 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-703.gb4d9cc45 2021-02-10T23:33:22.623 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-02-10T23:33:22.636 INFO:teuthology.task.internal:no buildpackages task found 2021-02-10T23:33:22.636 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-02-10T23:33:24.048 INFO:teuthology.task.internal:Saving configuration 2021-02-10T23:33:24.059 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-02-10T23:33:25.417 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-02-10T23:33:25.438 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-02-10 23:28:33.367002', 'description': '/home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961', 'locked_by': 'scheduled_hmunjulu@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNY/Hdk6xp0dyIrduKuz2gPk8/6lfE9rCsfUg3IvrDstBzAozixmwuT7SI8pudCydt79rr8XQb42kI9qimgy4rs=', 'os_version': '8.3', 'machine_type': 'gibba', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'gibba001.front.sepia.ceph.com'} 2021-02-10T23:33:25.438 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-02-10T23:33:25.987 INFO:teuthology.task.internal:roles: ubuntu@gibba001.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'osd.0', 'osd.1', 'client.0'] 2021-02-10T23:33:25.987 INFO:teuthology.run_tasks:Running task console_log... 2021-02-10T23:33:26.963 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f301a6e72f0>, signals=[15]) 2021-02-10T23:33:26.963 INFO:teuthology.run_tasks:Running task internal.connect... 2021-02-10T23:33:27.917 INFO:teuthology.task.internal:Opening connections... 2021-02-10T23:33:27.917 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba001.front.sepia.ceph.com 2021-02-10T23:33:27.920 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-10T23:33:27.988 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-02-10T23:33:28.960 DEBUG:teuthology.orchestra.run.gibba001:> uname -m 2021-02-10T23:33:28.973 INFO:teuthology.orchestra.run.gibba001.stdout:x86_64 2021-02-10T23:33:28.973 DEBUG:teuthology.orchestra.run.gibba001:> cat /etc/os-release 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:NAME="Red Hat Enterprise Linux" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION="8.3 (Ootpa)" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:ID="rhel" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:ID_LIKE="fedora" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:VERSION_ID="8.3" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:PLATFORM_ID="platform:el8" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:ANSI_COLOR="0;31" 2021-02-10T23:33:29.026 INFO:teuthology.orchestra.run.gibba001.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:HOME_URL="https://www.redhat.com/" 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2021-02-10T23:33:29.027 INFO:teuthology.orchestra.run.gibba001.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2021-02-10T23:33:29.028 INFO:teuthology.lock.ops:Updating gibba001.front.sepia.ceph.com on lock server 2021-02-10T23:33:29.066 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-02-10T23:33:39.321 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-02-10T23:33:39.329 INFO:teuthology.task.internal:Checking for old test directory... 2021-02-10T23:33:39.329 DEBUG:teuthology.orchestra.run.gibba001:> test '!' -e /home/ubuntu/cephtest 2021-02-10T23:33:39.341 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-02-10T23:33:40.165 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-02-10T23:33:40.165 DEBUG:teuthology.orchestra.run.gibba001:> test -z $(ls -A /var/lib/ceph) 2021-02-10T23:33:40.202 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-02-10T23:33:41.196 INFO:teuthology.run_tasks:Running task kernel... 2021-02-10T23:33:41.678 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}} 2021-02-10T23:33:41.679 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-02-10T23:33:41.679 DEBUG:teuthology.orchestra.run.gibba001:> uname -r 2021-02-10T23:33:41.691 INFO:teuthology.orchestra.run.gibba001.stdout:4.18.0-240.1.1.el8_3.x86_64 2021-02-10T23:33:41.691 INFO:teuthology.task.kernel:Running kernel on gibba001: 4.18.0-240.1.1.el8_3.x86_64 2021-02-10T23:33:41.691 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum install -y kernel 2021-02-10T23:33:43.006 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:33:43.008 INFO:teuthology.orchestra.run.gibba001.stdout:Unable to read consumer identity 2021-02-10T23:33:43.083 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:43.083 INFO:teuthology.orchestra.run.gibba001.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-02-10T23:33:43.083 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:44.595 INFO:teuthology.orchestra.run.gibba001.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.8 MB 00:00 2021-02-10T23:33:45.902 INFO:teuthology.orchestra.run.gibba001.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2021-02-10T23:33:46.384 INFO:teuthology.orchestra.run.gibba001.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2021-02-10T23:33:46.384 INFO:teuthology.orchestra.run.gibba001.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-02-10T23:33:46.498 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:33:46.512 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:33:46.512 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:33:46.583 DEBUG:teuthology.orchestra.run.gibba001:> echo no | sudo yum reinstall kernel || true 2021-02-10T23:33:46.778 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:33:46.778 INFO:teuthology.orchestra.run.gibba001.stdout:Unable to read consumer identity 2021-02-10T23:33:46.823 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:46.823 INFO:teuthology.orchestra.run.gibba001.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-02-10T23:33:46.823 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:46.935 INFO:teuthology.orchestra.run.gibba001.stdout:Last metadata expiration check: 0:00:01 ago on Wed 10 Feb 2021 11:33:45 PM UTC. 2021-02-10T23:33:47.040 INFO:teuthology.orchestra.run.gibba001.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-02-10T23:33:47.040 INFO:teuthology.orchestra.run.gibba001.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-02-10T23:33:47.087 INFO:teuthology.orchestra.run.gibba001.stderr:Error: No packages marked for reinstall. 2021-02-10T23:33:47.107 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum reinstall -y kernel || true 2021-02-10T23:33:47.303 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:33:47.303 INFO:teuthology.orchestra.run.gibba001.stdout:Unable to read consumer identity 2021-02-10T23:33:47.346 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:47.346 INFO:teuthology.orchestra.run.gibba001.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2021-02-10T23:33:47.346 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:33:47.458 INFO:teuthology.orchestra.run.gibba001.stdout:Last metadata expiration check: 0:00:02 ago on Wed 10 Feb 2021 11:33:45 PM UTC. 2021-02-10T23:33:47.563 INFO:teuthology.orchestra.run.gibba001.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2021-02-10T23:33:47.563 INFO:teuthology.orchestra.run.gibba001.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2021-02-10T23:33:47.590 INFO:teuthology.orchestra.run.gibba001.stderr:Error: No packages marked for reinstall. 2021-02-10T23:33:47.612 DEBUG:teuthology.orchestra.run.gibba001:> rpm -q kernel --last | head -n 1 2021-02-10T23:33:47.678 INFO:teuthology.orchestra.run.gibba001.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:15:51 PM UTC 2021-02-10T23:33:47.679 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2021-02-10T23:33:47.679 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2021-02-10T23:33:47.680 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-02-10T23:33:47.680 DEBUG:teuthology.orchestra.run.gibba001:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-02-10T23:33:47.701 INFO:teuthology.orchestra.run.gibba001.stdout:ttyS1 2021-02-10T23:33:47.720 INFO:teuthology.run_tasks:Running task internal.base... 2021-02-10T23:33:47.730 INFO:teuthology.task.internal:Creating test directory... 2021-02-10T23:33:47.730 DEBUG:teuthology.orchestra.run.gibba001:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-02-10T23:33:47.773 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-02-10T23:33:48.810 INFO:teuthology.run_tasks:Running task internal.archive... 2021-02-10T23:33:50.079 INFO:teuthology.task.internal:Creating archive directory... 2021-02-10T23:33:50.079 DEBUG:teuthology.orchestra.run.gibba001:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-02-10T23:33:50.100 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-02-10T23:33:50.710 INFO:teuthology.task.internal:Enabling coredump saving... 2021-02-10T23:33:50.711 DEBUG:teuthology.orchestra.run.gibba001:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-02-10T23:33:50.739 INFO:teuthology.orchestra.run.gibba001.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-10T23:33:50.747 INFO:teuthology.orchestra.run.gibba001.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-02-10T23:33:50.748 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-02-10T23:33:51.351 INFO:teuthology.task.internal:Configuring sudo... 2021-02-10T23:33:51.351 DEBUG:teuthology.orchestra.run.gibba001:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-02-10T23:33:51.371 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-02-10T23:33:52.093 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-02-10T23:33:52.093 DEBUG:teuthology.orchestra.run.gibba001:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-02-10T23:33:52.105 DEBUG:teuthology.orchestra.run.gibba001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-10T23:33:52.175 DEBUG:teuthology.orchestra.run.gibba001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-02-10T23:33:52.231 DEBUG:teuthology.orchestra.run.gibba001:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-10T23:33:52.432 DEBUG:teuthology.orchestra.run.gibba001:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-02-10T23:33:52.475 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:33:52.476 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-02-10T23:33:52.601 DEBUG:teuthology.orchestra.run.gibba001:> sudo service rsyslog restart 2021-02-10T23:33:52.733 INFO:teuthology.orchestra.run.gibba001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-10T23:33:52.747 INFO:teuthology.run_tasks:Running task internal.timer... 2021-02-10T23:33:52.955 INFO:teuthology.task.internal:Starting timer... 2021-02-10T23:33:52.955 INFO:teuthology.run_tasks:Running task pcp... 2021-02-10T23:33:53.392 INFO:teuthology.run_tasks:Running task selinux... 2021-02-10T23:33:54.934 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-02-10T23:33:54.935 DEBUG:teuthology.orchestra.run.gibba001:> sudo service auditd rotate 2021-02-10T23:33:54.982 INFO:teuthology.orchestra.run.gibba001.stdout:Rotating logs: [ OK ] 2021-02-10T23:33:54.983 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-02-10T23:33:54.983 DEBUG:teuthology.orchestra.run.gibba001:> /usr/sbin/getenforce 2021-02-10T23:33:54.997 INFO:teuthology.orchestra.run.gibba001.stdout:Permissive 2021-02-10T23:33:54.997 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@gibba001.front.sepia.ceph.com': 'permissive'} 2021-02-10T23:33:54.997 DEBUG:teuthology.orchestra.run.gibba001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-10T23:33:55.057 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-10T23:33:55.058 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-02-10T23:33:55.058 DEBUG:teuthology.orchestra.run.gibba001:> sudo /usr/sbin/setenforce permissive 2021-02-10T23:33:55.116 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-02-10T23:33:55.865 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-02-10T23:33:55.883 INFO:teuthology.repo_utils:Fetching master from origin 2021-02-10T23:33:56.102 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-02-10T23:33:56.315 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-02-10T23:33:56.329 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba001.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-02-10T23:33:57.141 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-02-10T23:33:59.097 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-02-10T23:34:02.030 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-02-10T23:34:02.075 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:02 +0000 (0:00:00.160) 0:00:00.160 **** 2021-02-10T23:34:03.386 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba001.front.sepia.ceph.com] 2021-02-10T23:34:03.470 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:03 +0000 (0:00:01.394) 0:00:01.554 **** 2021-02-10T23:34:03.769 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-02-10T23:34:03.771 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-10T23:34:03.807 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:03 +0000 (0:00:00.337) 0:00:01.892 **** 2021-02-10T23:34:04.192 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-02-10T23:34:04.194 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-02-10T23:34:04.230 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:04 +0000 (0:00:00.423) 0:00:02.315 **** 2021-02-10T23:34:04.259 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-02-10T23:34:04.259 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:04.261 INFO:teuthology.task.ansible.out: 2021-02-10T23:34:04.317 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:04 +0000 (0:00:00.086) 0:00:02.401 **** 2021-02-10T23:34:04.597 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-02-10T23:34:04.599 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-10T23:34:04.635 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:04 +0000 (0:00:00.318) 0:00:02.719 **** 2021-02-10T23:34:05.508 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-02-10T23:34:05.509 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613000044.6490803-251836767797910/source", "state": "file", "uid": 0} 2021-02-10T23:34:05.558 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:05 +0000 (0:00:00.923) 0:00:03.643 **** 2021-02-10T23:34:06.082 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-02-10T23:34:06.084 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-02-10T23:34:06.085 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-02-10T23:34:06.179 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-02-10T23:34:06.185 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-02-10T23:34:06.343 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:06 +0000 (0:00:00.784) 0:00:04.427 **** 2021-02-10T23:34:07.921 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba001.front.sepia.ceph.com] 2021-02-10T23:34:08.002 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-02-10T23:34:08.004 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:07 +0000 (0:00:01.659) 0:00:06.087 **** 2021-02-10T23:34:08.974 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-02-10T23:34:08.975 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.444561", "end": "2021-02-10 23:34:08.948673", "rc": 0, "start": "2021-02-10 23:34:08.504112", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-02-10T23:34:09.010 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:01.007) 0:00:07.094 **** 2021-02-10T23:34:09.173 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-02-10T23:34:09.175 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010098", "end": "2021-02-10 23:34:09.150785", "failed_when_result": false, "rc": 0, "start": "2021-02-10 23:34:09.140687", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2021-02-10T23:34:09.214 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.204) 0:00:07.299 **** 2021-02-10T23:34:09.245 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-02-10T23:34:09.246 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:09.280 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.066) 0:00:07.365 **** 2021-02-10T23:34:09.282 INFO:teuthology.task.ansible.out: 2021-02-10T23:34:09.309 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-02-10T23:34:09.310 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:09.344 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.063) 0:00:07.428 **** 2021-02-10T23:34:09.371 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2021-02-10T23:34:09.373 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:09.407 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.063) 0:00:07.492 **** 2021-02-10T23:34:09.434 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-02-10T23:34:09.435 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:09.467 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.059) 0:00:07.551 **** 2021-02-10T23:34:09.494 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-02-10T23:34:09.495 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:09.528 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.060) 0:00:07.612 **** 2021-02-10T23:34:09.691 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-02-10T23:34:09.693 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-10T23:34:09.725 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:09 +0000 (0:00:00.197) 0:00:07.810 **** 2021-02-10T23:34:09.919 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-02-10T23:34:09.920 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-02-10T23:34:10.067 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-02-10T23:34:10.212 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-02-10T23:34:10.360 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-02-10T23:34:10.496 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-02-10T23:34:10.641 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-02-10T23:34:10.780 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-02-10T23:34:10.928 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-02-10T23:34:11.075 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-02-10T23:34:11.223 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-02-10T23:34:11.370 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-02-10T23:34:11.528 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-02-10T23:34:11.675 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-02-10T23:34:11.826 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-02-10T23:34:11.973 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-02-10T23:34:12.120 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-02-10T23:34:12.267 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-02-10T23:34:12.402 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-02-10T23:34:12.560 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-02-10T23:34:12.699 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-02-10T23:34:12.843 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-02-10T23:34:12.851 INFO:teuthology.task.ansible.out: 2021-02-10T23:34:12.980 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-02-10T23:34:13.129 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-02-10T23:34:13.313 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-02-10T23:34:13.471 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-02-10T23:34:13.619 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-02-10T23:34:13.778 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-02-10T23:34:13.933 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-02-10T23:34:14.083 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-02-10T23:34:14.231 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-02-10T23:34:14.367 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-02-10T23:34:14.513 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-02-10T23:34:14.659 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-02-10T23:34:14.816 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-02-10T23:34:14.963 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-02-10T23:34:15.099 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-02-10T23:34:15.246 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-02-10T23:34:15.382 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-02-10T23:34:15.529 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-10T23:34:15.674 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-02-10T23:34:15.814 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-02-10T23:34:15.973 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-02-10T23:34:16.109 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-02-10T23:34:16.255 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-02-10T23:34:16.421 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-02-10T23:34:16.558 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-02-10T23:34:16.705 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-10T23:34:16.851 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-02-10T23:34:16.989 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-02-10T23:34:16.991 INFO:teuthology.task.ansible.out: 2021-02-10T23:34:17.137 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-02-10T23:34:17.274 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-02-10T23:34:17.420 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-02-10T23:34:17.557 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-02-10T23:34:17.703 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-02-10T23:34:17.853 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-02-10T23:34:17.991 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-02-10T23:34:18.129 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-02-10T23:34:18.276 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-02-10T23:34:18.424 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-02-10T23:34:18.561 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-02-10T23:34:18.707 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-02-10T23:34:18.856 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-02-10T23:34:19.003 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-02-10T23:34:19.138 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-02-10T23:34:19.284 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-02-10T23:34:19.419 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-02-10T23:34:19.566 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-02-10T23:34:19.712 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-02-10T23:34:19.848 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-02-10T23:34:19.994 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-02-10T23:34:20.141 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-02-10T23:34:20.278 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-02-10T23:34:20.435 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-02-10T23:34:20.584 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-02-10T23:34:20.720 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-02-10T23:34:20.868 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-02-10T23:34:21.018 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-02-10T23:34:21.163 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-02-10T23:34:21.310 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-02-10T23:34:21.467 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-02-10T23:34:21.602 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-02-10T23:34:21.749 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-02-10T23:34:21.886 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-02-10T23:34:22.032 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-02-10T23:34:22.177 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-02-10T23:34:22.324 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-02-10T23:34:22.505 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-02-10T23:34:22.607 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-02-10T23:34:22.743 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-02-10T23:34:22.890 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-02-10T23:34:23.037 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-02-10T23:34:23.204 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-02-10T23:34:23.319 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-02-10T23:34:23.470 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-02-10T23:34:23.616 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-02-10T23:34:23.763 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-02-10T23:34:23.931 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-02-10T23:34:24.077 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-02-10T23:34:24.214 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-02-10T23:34:24.360 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-02-10T23:34:24.505 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-02-10T23:34:24.651 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-02-10T23:34:24.796 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-02-10T23:34:24.942 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-02-10T23:34:25.079 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-02-10T23:34:25.225 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-02-10T23:34:25.371 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-02-10T23:34:25.519 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-02-10T23:34:25.656 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-02-10T23:34:25.815 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-02-10T23:34:25.964 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-02-10T23:34:26.122 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-02-10T23:34:26.259 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-02-10T23:34:26.406 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-02-10T23:34:26.554 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-02-10T23:34:26.691 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-02-10T23:34:26.839 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-02-10T23:34:26.988 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-02-10T23:34:27.126 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-02-10T23:34:27.271 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-02-10T23:34:27.418 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-02-10T23:34:27.566 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-02-10T23:34:27.715 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-02-10T23:34:27.865 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-02-10T23:34:28.013 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-02-10T23:34:28.151 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-02-10T23:34:28.299 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-02-10T23:34:28.437 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-02-10T23:34:28.583 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-02-10T23:34:28.740 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-02-10T23:34:28.887 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-02-10T23:34:29.023 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-02-10T23:34:29.169 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-02-10T23:34:29.315 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-02-10T23:34:29.452 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-02-10T23:34:30.636 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-02-10T23:34:32.082 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "name": "adking", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-02-10T23:34:33.492 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "name": "amathuri", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-02-10T23:34:34.682 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-02-10T23:34:34.798 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:34 +0000 (0:00:25.072) 0:00:32.882 **** 2021-02-10T23:34:34.825 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-02-10T23:34:34.859 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:34 +0000 (0:00:00.060) 0:00:32.943 **** 2021-02-10T23:34:34.907 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-02-10T23:34:34.909 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora r 2021-02-10T23:34:34.910 INFO:teuthology.task.ansible.out:T6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c 2021-02-10T23:34:34.912 INFO:teuthology.task.ansible.out:63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich 2021-02-10T23:34:34.913 INFO:teuthology.task.ansible.out:", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiR 2021-02-10T23:34:34.914 INFO:teuthology.task.ansible.out:enVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumr 2021-02-10T23:34:34.916 INFO:teuthology.task.ansible.out:ao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69m 2021-02-10T23:34:34.917 INFO:teuthology.task.ansible.out:h95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d84 2021-02-10T23:34:34.918 INFO:teuthology.task.ansible.out:1a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan 2021-02-10T23:34:34.919 INFO:teuthology.task.ansible.out:@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOen 2021-02-10T23:34:34.921 INFO:teuthology.task.ansible.out:VV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9g 2021-02-10T23:34:34.922 INFO:teuthology.task.ansible.out:I46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": " 2021-02-10T23:34:34.924 INFO:teuthology.task.ansible.out:dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NIN 2021-02-10T23:34:34.925 INFO:teuthology.task.ansible.out:j0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}]}, "changed": false} 2021-02-10T23:34:34.965 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:34 +0000 (0:00:00.106) 0:00:33.049 **** 2021-02-10T23:34:36.147 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-02-10T23:34:36.148 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com -> localhost] => {"after": "df8946f08e870e2d2565b79099289ca48bd825f3", "attempts": 1, "before": "df8946f08e870e2d2565b79099289ca48bd825f3", "changed": false, "remote_url_changed": false} 2021-02-10T23:34:36.183 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:34:36 +0000 (0:00:01.217) 0:00:34.267 **** 2021-02-10T23:34:36.473 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-02-10T23:34:36.474 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-02-10T23:34:36.652 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-02-10T23:34:36.831 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-02-10T23:34:37.010 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-02-10T23:34:37.011 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-02-10T23:34:37.189 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-02-10T23:34:37.367 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-02-10T23:34:37.369 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-02-10T23:34:37.536 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-02-10T23:34:37.712 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-02-10T23:34:37.897 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-02-10T23:34:37.910 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:38.093 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-02-10T23:34:38.094 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-02-10T23:34:38.275 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-02-10T23:34:38.276 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-02-10T23:34:38.287 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:38.299 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:34:38.501 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-02-10T23:34:38.681 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-02-10T23:34:38.683 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-02-10T23:34:38.882 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-02-10T23:34:39.061 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2021-02-10T23:34:39.240 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-02-10T23:34:39.429 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-02-10T23:34:39.620 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-02-10T23:34:39.798 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-02-10T23:34:39.799 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-02-10T23:34:39.988 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-02-10T23:34:39.989 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-02-10T23:34:40.176 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-02-10T23:34:40.370 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-02-10T23:34:40.559 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46T 2021-02-10T23:34:40.561 INFO:teuthology.task.ansible.out:RJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-02-10T23:34:40.739 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-02-10T23:34:40.918 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-02-10T23:34:41.110 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-02-10T23:34:41.300 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-02-10T23:34:41.479 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-02-10T23:34:41.668 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-02-10T23:34:41.711 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-02-10T23:34:41.856 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-02-10T23:34:42.036 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-02-10T23:34:42.216 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-02-10T23:34:42.415 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-02-10T23:34:42.595 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2021-02-10T23:34:42.795 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-02-10T23:34:42.994 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-10T23:34:43.174 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-02-10T23:34:43.353 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-02-10T23:34:43.532 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-02-10T23:34:43.533 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-02-10T23:34:43.713 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-02-10T23:34:43.891 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-02-10T23:34:43.904 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-02-10T23:34:44.076 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-02-10T23:34:44.289 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-02-10T23:34:44.496 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": nul 2021-02-10T23:34:44.497 INFO:teuthology.task.ansible.out:l, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-10T23:34:44.706 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-02-10T23:34:44.707 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-02-10T23:34:44.709 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-02-10T23:34:44.905 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-02-10T23:34:45.083 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-02-10T23:34:45.261 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-02-10T23:34:45.438 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-02-10T23:34:45.617 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-02-10T23:34:45.796 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-02-10T23:34:45.797 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-02-10T23:34:45.974 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-02-10T23:34:46.143 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-02-10T23:34:46.322 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-02-10T23:34:46.324 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-02-10T23:34:46.490 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-02-10T23:34:46.668 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-02-10T23:34:46.847 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-02-10T23:34:46.849 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-02-10T23:34:47.036 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-02-10T23:34:47.205 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-02-10T23:34:47.383 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-02-10T23:34:47.571 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-02-10T23:34:47.739 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-02-10T23:34:47.927 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-02-10T23:34:48.106 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-02-10T23:34:48.284 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-02-10T23:34:48.461 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-02-10T23:34:48.641 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-02-10T23:34:48.818 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-02-10T23:34:48.997 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-02-10T23:34:49.163 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-02-10T23:34:49.341 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-02-10T23:34:49.529 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-02-10T23:34:49.718 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-02-10T23:34:49.886 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-02-10T23:34:50.071 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-02-10T23:34:50.239 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-02-10T23:34:50.417 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-02-10T23:34:50.597 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-02-10T23:34:50.598 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-02-10T23:34:50.775 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-02-10T23:34:50.953 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-02-10T23:34:51.131 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-02-10T23:34:51.321 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-02-10T23:34:51.488 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.localdo 2021-02-10T23:34:51.678 INFO:teuthology.task.ansible.out:main", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJ 2021-02-10T23:34:51.680 INFO:teuthology.task.ansible.out:Mlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-02-10T23:34:51.847 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-02-10T23:34:52.031 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-02-10T23:34:52.219 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-02-10T23:34:52.385 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-02-10T23:34:52.573 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-02-10T23:34:52.750 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-02-10T23:34:52.927 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-02-10T23:34:53.106 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-02-10T23:34:53.133 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-02-10T23:34:53.283 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-02-10T23:34:53.460 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-02-10T23:34:53.637 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-02-10T23:34:53.816 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-02-10T23:34:54.034 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-02-10T23:34:54.171 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-02-10T23:34:54.349 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", " 2021-02-10T23:34:54.414 INFO:teuthology.task.ansible.out:manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-02-10T23:34:54.528 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-02-10T23:34:54.695 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-02-10T23:34:54.996 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-02-10T23:34:55.206 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-02-10T23:34:55.385 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-02-10T23:34:55.563 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-02-10T23:34:55.745 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-02-10T23:34:55.933 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-02-10T23:34:56.115 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-02-10T23:34:56.292 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-02-10T23:34:56.460 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-02-10T23:34:56.638 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-02-10T23:34:56.816 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-02-10T23:34:57.023 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-02-10T23:34:57.201 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-02-10T23:34:57.391 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-02-10T23:34:57.560 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-02-10T23:34:57.738 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-02-10T23:34:57.915 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-02-10T23:34:57.916 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-02-10T23:34:58.092 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-02-10T23:34:58.270 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-02-10T23:34:58.447 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-02-10T23:34:58.625 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-02-10T23:34:58.803 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-02-10T23:34:58.974 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-02-10T23:34:59.161 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-02-10T23:34:59.339 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-02-10T23:34:59.537 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-02-10T23:34:59.705 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-02-10T23:34:59.882 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-02-10T23:35:00.059 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-02-10T23:35:00.249 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-02-10T23:35:00.428 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-02-10T23:35:00.606 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-02-10T23:35:00.784 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-02-10T23:35:00.974 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com", "key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-02-10T23:35:01.163 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-02-10T23:35:01.252 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:01 +0000 (0:00:25.069) 0:00:59.337 **** 2021-02-10T23:35:01.474 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1 2021-02-10T23:35:01.476 INFO:teuthology.task.ansible.out:I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34 2021-02-10T23:35:01.477 INFO:teuthology.task.ansible.out:f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:01.557 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-02-10T23:35:01.558 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:01.569 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:01.740 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-02-10T23:35:01.918 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-02-10T23:35:01.929 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.170 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubunt 2021-02-10T23:35:02.172 INFO:teuthology.task.ansible.out:u-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2021-02-10T23:35:02.173 INFO:teuthology.task.ansible.out:: "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reas 2021-02-10T23:35:02.174 INFO:teuthology.task.ansible.out:on": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6 2021-02-10T23:35:02.175 INFO:teuthology.task.ansible.out:fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={ 2021-02-10T23:35:02.177 INFO:teuthology.task.ansible.out:'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditiona 2021-02-10T23:35:02.178 INFO:teuthology.task.ansible.out:l result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.185 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.186 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.197 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.208 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.219 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.219 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.230 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.407 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed" 2021-02-10T23:35:02.408 INFO:teuthology.task.ansible.out:: false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (it 2021-02-10T23:35:02.410 INFO:teuthology.task.ansible.out:em={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/Ffa 2021-02-10T23:35:02.411 INFO:teuthology.task.ansible.out:Q/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var 2021-02-10T23:35:02.412 INFO:teuthology.task.ansible.out:": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.419 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.419 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.430 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.441 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.441 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.453 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.464 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.485 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.487 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.498 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.498 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.509 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.520 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.531 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.542 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.551 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.553 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.564 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.575 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.586 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.685 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 's 2021-02-10T23:35:02.686 INFO:teuthology.task.ansible.out:koduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011 2021-02-10T23:35:02.688 INFO:teuthology.task.ansible.out:a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was Fal 2021-02-10T23:35:02.689 INFO:teuthology.task.ansible.out:se"} 2021-02-10T23:35:02.697 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.697 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.708 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.719 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.720 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.731 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.861 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu B 2021-02-10T23:35:02.862 INFO:teuthology.task.ansible.out:qyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d 2021-02-10T23:35:02.863 INFO:teuthology.task.ansible.out:65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": " 2021-02-10T23:35:02.865 INFO:teuthology.task.ansible.out:Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.876 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.887 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:02.898 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:03.178 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {" 2021-02-10T23:35:03.179 INFO:teuthology.task.ansible.out:ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Condit 2021-02-10T23:35:03.181 INFO:teuthology.task.ansible.out:ional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": 2021-02-10T23:35:03.182 INFO:teuthology.task.ansible.out: {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:35:03 +0000 (0:00:01.819) 0:01:01.156 **** TASK [users : Filter the revoked_users list] *********************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:35:03 +0000 (0:00:00.060) 0:01:01.216 **** 2021-02-10T23:35:03.307 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-02-10T23:35:03.927 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-02-10T23:35:04.000 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-02-10T23:35:04.581 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-02-10T23:35:04.694 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-02-10T23:35:04.842 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-02-10T23:35:05.829 INFO:teuthology.task.ansible.out: ok: [gibba001.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} ok: [gibba001.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-02-10T23:35:05.879 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-02-10T23:35:06.018 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-02-10T23:35:06.165 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-02-10T23:35:06.303 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-02-10T23:35:06.440 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2021-02-10T23:35:06.576 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-02-10T23:35:06.723 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-02-10T23:35:06.869 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-02-10T23:35:07.006 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-02-10T23:35:07.142 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-02-10T23:35:07.289 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-02-10T23:35:07.424 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-02-10T23:35:07.572 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-02-10T23:35:07.708 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-02-10T23:35:07.843 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-02-10T23:35:07.989 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-02-10T23:35:08.125 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-02-10T23:35:08.265 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-02-10T23:35:08.412 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-02-10T23:35:08.548 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-02-10T23:35:09.740 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "dorinda", "name": "dorinda", "remove": false, "state": "absent"} 2021-02-10T23:35:10.981 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "zyan", "name": "zyan", "remove": false, "state": "absent"} 2021-02-10T23:35:11.126 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-02-10T23:35:11.272 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-02-10T23:35:11.419 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-02-10T23:35:11.565 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-02-10T23:35:11.710 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-02-10T23:35:11.846 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-02-10T23:35:11.981 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-02-10T23:35:12.129 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-02-10T23:35:12.265 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-02-10T23:35:12.412 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-02-10T23:35:12.471 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:12 +0000 (0:00:09.339) 0:01:10.555 **** 2021-02-10T23:35:12.883 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "checksum": "5ebc9fcf8859a9c716ab10089a7bec7e44d29368", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "ee06ed012f51c2e3764171d4b9180349", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613000112.494233-142571801562633/source", "state": "file", "uid": 0} 2021-02-10T23:35:12.922 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:12 +0000 (0:00:00.451) 0:01:11.006 **** 2021-02-10T23:35:12.959 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [gibba001.front.sepia.ceph.com] => { "msg": "Host gibba001.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2021-02-10T23:35:12.998 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:12 +0000 (0:00:00.076) 0:01:11.082 **** 2021-02-10T23:35:13.036 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-02-10T23:35:13.038 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2021-02-10T23:35:13.070 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.072) 0:01:11.155 **** 2021-02-10T23:35:13.097 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-02-10T23:35:13.098 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:13.131 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.060) 0:01:11.215 **** 2021-02-10T23:35:13.676 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-02-10T23:35:13.678 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.388721", "end": "2021-02-10 23:35:13.656641", "rc": 0, "start": "2021-02-10 23:35:13.267920", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-02-10T23:35:13.710 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.579) 0:01:11.795 **** 2021-02-10T23:35:13.737 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-02-10T23:35:13.739 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:13.774 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.063) 0:01:11.858 **** 2021-02-10T23:35:13.801 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-02-10T23:35:13.803 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:13.837 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.063) 0:01:11.922 **** 2021-02-10T23:35:13.864 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-02-10T23:35:13.865 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:13.898 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.060) 0:01:11.983 **** 2021-02-10T23:35:13.925 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-02-10T23:35:13.926 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:13.959 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:13 +0000 (0:00:00.060) 0:01:12.043 **** 2021-02-10T23:35:13.996 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-02-10T23:35:13.998 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:14.030 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:14 +0000 (0:00:00.071) 0:01:12.115 **** 2021-02-10T23:35:14.068 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2021-02-10T23:35:14.708 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:14 +0000 (0:00:00.071) 0:01:12.187 **** TASK [common : Include Red Hat encrypted variables.] *************************** ok: [gibba001.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [gibba001.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Wednesday 10 February 2021 23:35:14 +0000 (0:00:00.081) 0:01:12.269 **** TASK [common : Set have_entitlements] ****************************************** ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} Wednesday 10 February 2021 23:35:14 +0000 (0:00:00.076) 0:01:12.346 **** 2021-02-10T23:35:15.265 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-02-10T23:35:15.266 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1613000115.167307-q1zcm_nw/katello-ca-consumer-latest.noarchd5q2hxrj.rpm"]} 2021-02-10T23:35:15.319 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:15 +0000 (0:00:01.057) 0:01:13.403 **** 2021-02-10T23:35:15.810 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-02-10T23:35:15.812 INFO:teuthology.task.ansible.out:fatal: [gibba001.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2021-02-10T23:35:15.846 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:15 +0000 (0:00:00.527) 0:01:13.931 **** 2021-02-10T23:35:15.887 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-02-10T23:35:15.889 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2021-02-10T23:35:15.943 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:15 +0000 (0:00:00.096) 0:01:14.028 **** 2021-02-10T23:35:28.128 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [gibba001.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-10T23:35:28.163 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:12.219) 0:01:26.247 **** 2021-02-10T23:35:28.201 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-02-10T23:35:28.202 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2021-02-10T23:35:28.235 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.071) 0:01:26.319 **** 2021-02-10T23:35:28.682 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-02-10T23:35:28.684 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.285301", "end": "2021-02-10 23:35:28.662399", "failed_when_result": false, "rc": 0, "start": "2021-02-10 23:35:28.377098", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2021-02-10T23:35:28.717 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.482) 0:01:26.801 **** 2021-02-10T23:35:28.754 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-02-10T23:35:28.756 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:28.788 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.070) 0:01:26.872 **** 2021-02-10T23:35:28.824 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-02-10T23:35:28.826 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:28.858 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.070) 0:01:26.942 **** 2021-02-10T23:35:28.885 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-02-10T23:35:28.886 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-02-10T23:35:28.918 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.060) 0:01:27.003 **** 2021-02-10T23:35:28.955 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-10T23:35:28.957 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:28.989 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:28 +0000 (0:00:00.070) 0:01:27.073 **** 2021-02-10T23:35:30.949 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-02-10T23:35:30.951 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:01.799046", "end": "2021-02-10 23:35:30.927453", "rc": 0, "start": "2021-02-10 23:35:29.128407", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2021-02-10T23:35:30.984 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:30 +0000 (0:00:01.994) 0:01:29.068 **** 2021-02-10T23:35:31.035 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-02-10T23:35:31.037 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2021-02-10T23:35:31.069 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:31 +0000 (0:00:00.085) 0:01:29.153 **** 2021-02-10T23:35:31.105 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:31.140 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:31 +0000 (0:00:00.070) 0:01:29.224 **** 2021-02-10T23:35:31.186 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-02-10T23:35:31.188 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2021-02-10T23:35:31.221 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:31 +0000 (0:00:00.081) 0:01:29.305 **** 2021-02-10T23:35:31.258 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2021-02-10T23:35:31.291 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:31 +0000 (0:00:00.070) 0:01:29.376 **** 2021-02-10T23:35:33.092 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-02-10T23:35:33.093 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-10T23:35:33.127 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:33 +0000 (0:00:01.835) 0:01:31.211 **** 2021-02-10T23:35:35.606 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-02-10T23:35:35.607 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:02.318920", "end": "2021-02-10 23:35:35.589072", "rc": 0, "start": "2021-02-10 23:35:33.270152", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2021-02-10T23:35:35.640 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:35 +0000 (0:00:02.513) 0:01:33.725 **** 2021-02-10T23:35:36.155 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-02-10T23:35:36.156 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2021-02-10T23:35:36.211 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:36 +0000 (0:00:00.570) 0:01:34.295 **** 2021-02-10T23:35:36.392 INFO:teuthology.task.ansible.out: 2021-02-10T23:35:36.394 INFO:teuthology.task.ansible.out:TASK [common : Increase the yum timeout.] ************************************** ok: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-10T23:35:36.427 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:36 +0000 (0:00:00.216) 0:01:34.511 **** 2021-02-10T23:35:36.818 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-02-10T23:35:36.820 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-02-10T23:35:37.163 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-02-10T23:35:37.205 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:37 +0000 (0:00:00.778) 0:01:35.290 **** 2021-02-10T23:35:37.590 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-02-10T23:35:37.599 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-02-10T23:35:37.971 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-02-10T23:35:38.015 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.809) 0:01:36.100 **** 2021-02-10T23:35:38.053 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-02-10T23:35:38.055 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.088 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.072) 0:01:36.172 **** 2021-02-10T23:35:38.115 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-10T23:35:38.116 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.150 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.062) 0:01:36.235 **** 2021-02-10T23:35:38.179 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.213 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.062) 0:01:36.297 **** 2021-02-10T23:35:38.240 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.275 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.062) 0:01:36.360 **** 2021-02-10T23:35:38.313 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-02-10T23:35:38.315 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.325 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.367 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.091) 0:01:36.452 **** 2021-02-10T23:35:38.401 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-02-10T23:35:38.402 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.449 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.081) 0:01:36.533 **** 2021-02-10T23:35:38.478 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-02-10T23:35:38.480 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.515 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.065) 0:01:36.599 **** 2021-02-10T23:35:38.544 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-02-10T23:35:38.545 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.597 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.082) 0:01:36.681 **** 2021-02-10T23:35:38.626 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-02-10T23:35:38.628 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.667 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.069) 0:01:36.751 **** 2021-02-10T23:35:38.694 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-02-10T23:35:38.696 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:38.728 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:38 +0000 (0:00:00.061) 0:01:36.812 **** 2021-02-10T23:35:40.522 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-02-10T23:35:40.524 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.630856", "end": "2021-02-10 23:35:40.502380", "rc": 0, "start": "2021-02-10 23:35:38.871524", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:35:40.566 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:40 +0000 (0:00:01.837) 0:01:38.650 **** 2021-02-10T23:35:42.755 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-02-10T23:35:42.755 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2021-02-10T23:35:42.791 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:42 +0000 (0:00:02.225) 0:01:40.876 **** 2021-02-10T23:35:42.818 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-02-10T23:35:42.818 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:42.856 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:42 +0000 (0:00:00.065) 0:01:40.941 **** 2021-02-10T23:35:42.884 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-02-10T23:35:42.885 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:42.919 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:42 +0000 (0:00:00.062) 0:01:41.004 **** 2021-02-10T23:35:42.946 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:42.981 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:42 +0000 (0:00:00.061) 0:01:41.065 **** 2021-02-10T23:35:43.018 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:43.056 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:43 +0000 (0:00:00.075) 0:01:41.141 **** 2021-02-10T23:35:43.423 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-02-10T23:35:43.424 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-02-10T23:35:43.461 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:43 +0000 (0:00:00.404) 0:01:41.545 **** 2021-02-10T23:35:45.376 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2021-02-10T23:35:45.417 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:45 +0000 (0:00:01.956) 0:01:43.501 **** 2021-02-10T23:35:45.826 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-02-10T23:35:45.827 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-02-10T23:35:46.161 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-02-10T23:35:46.527 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-02-10T23:35:46.567 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:46 +0000 (0:00:01.150) 0:01:44.651 **** 2021-02-10T23:35:46.742 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-02-10T23:35:46.743 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-02-10T23:35:46.783 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:46 +0000 (0:00:00.216) 0:01:44.868 **** 2021-02-10T23:35:47.259 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-02-10T23:35:47.261 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": true, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "md5sum": "14041bf2666d8f8d277567958c7e9f69", "mode": "0755", "owner": "root", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613000146.814278-10401306501921/source", "state": "file", "uid": 0} 2021-02-10T23:35:47.584 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-02-10T23:35:47.909 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2021-02-10T23:35:47.945 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:47 +0000 (0:00:01.161) 0:01:46.030 **** 2021-02-10T23:35:47.972 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-02-10T23:35:47.973 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:48.007 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:48 +0000 (0:00:00.061) 0:01:46.091 **** 2021-02-10T23:35:48.045 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-02-10T23:35:48.047 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2021-02-10T23:35:48.079 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:48 +0000 (0:00:00.072) 0:01:46.163 **** 2021-02-10T23:35:48.230 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-02-10T23:35:48.232 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-02-10T23:35:48.266 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:48 +0000 (0:00:00.186) 0:01:46.350 **** 2021-02-10T23:35:48.304 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-02-10T23:35:48.305 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:48.315 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:48.326 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:48.337 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:48.379 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:48 +0000 (0:00:00.112) 0:01:46.463 **** 2021-02-10T23:35:50.312 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-02-10T23:35:50.313 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2021-02-10T23:35:50.348 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:50 +0000 (0:00:01.968) 0:01:48.432 **** 2021-02-10T23:35:50.375 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-02-10T23:35:50.376 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:50.410 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:50 +0000 (0:00:00.062) 0:01:48.494 **** 2021-02-10T23:35:50.784 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-02-10T23:35:50.785 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-02-10T23:35:50.819 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:50 +0000 (0:00:00.408) 0:01:48.903 **** 2021-02-10T23:35:51.180 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-02-10T23:35:51.182 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-02-10T23:35:51.214 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:51 +0000 (0:00:00.395) 0:01:49.299 **** 2021-02-10T23:35:51.251 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-02-10T23:35:51.253 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:51.263 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-02-10T23:35:51.298 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:51 +0000 (0:00:00.084) 0:01:49.383 **** 2021-02-10T23:35:51.460 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-02-10T23:35:51.461 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-10T23:35:51.494 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:51 +0000 (0:00:00.195) 0:01:49.578 **** 2021-02-10T23:35:51.720 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-02-10T23:35:51.721 INFO:teuthology.task.ansible.out:fatal: [gibba001.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-02-10T23:35:51.772 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:51 +0000 (0:00:00.278) 0:01:49.856 **** 2021-02-10T23:35:51.801 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-02-10T23:35:51.802 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:35:51.837 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:51 +0000 (0:00:00.065) 0:01:49.922 **** 2021-02-10T23:35:52.208 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-02-10T23:35:52.209 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-02-10T23:35:52.244 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:52 +0000 (0:00:00.407) 0:01:50.329 **** 2021-02-10T23:35:52.989 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-02-10T23:35:52.990 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-10 23:32:56 UTC", "ActiveEnterTimestampMonotonic": "13480288", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target systemd-tmpfiles-setup.service system.slice -.mount systemd-journald.socket time-sync.target network.target var-run.mount sysinit.target basic.target local-fs.target tmp.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-10 23:32:56 UTC", "AssertTimestampMonotonic": "13479736", "Before": "shutdown.target plymouth-quit.service getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-10 23:32:56 UTC", "ConditionTimestampMonotonic": "13479735", "ConfigurationDirectoryMode": "0 2021-02-10T23:35:52.991 INFO:teuthology.task.ansible.out:755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1095", "ExecMainStartTimestamp": "Wed 2021-02-10 23:32:56 UTC", "ExecMainStartTimestampMonotonic": "13480254", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Wed 2021-02-10 23:32:56 UTC] ; stop_time=[n/a] ; pid=1095 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-10 23:32:56 UTC", "InactiveExitTimestampMonotonic": "13480288", "InvocationID": "71384b4037354533ae20bc1e4884401a", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infi 2021-02-10T23:35:52.992 INFO:teuthology.task.ansible.out:nity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1095", "MemoryAccounting": "yes", "MemoryCurrent": "1224704", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualS 2021-02-10T23:35:52.994 INFO:teuthology.task.ansible.out:tart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-10 23:32:56 UTC", "StateChangeTimestampMonotonic": "13480288", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-10 23:32:56 UTC", "WatchdogTimestampMonotonic": "13480288", "WatchdogUSec": "0"}} 2021-02-10T23:35:53.033 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:53 +0000 (0:00:00.788) 0:01:51.117 **** 2021-02-10T23:35:53.184 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-02-10T23:35:53.186 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001060", "end": "2021-02-10 23:35:53.169493", "rc": 0, "start": "2021-02-10 23:35:53.168433", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-02-10T23:35:53.218 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:53 +0000 (0:00:00.185) 0:01:51.303 **** 2021-02-10T23:35:55.159 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-02-10T23:35:55.160 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2021-02-10T23:35:55.193 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:35:55 +0000 (0:00:01.974) 0:01:53.278 **** 2021-02-10T23:36:23.058 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-02-10T23:36:23.060 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted", "Installed: selinux-policy-3.14.3-54.el8_3.2.noarch", "Installed: selinux-policy-targeted-3.14.3-54.el8_3.2.noarch", "Removed: selinux-policy-3.14.3-54.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-54.el8.noarch"]} 2021-02-10T23:36:23.093 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:23 +0000 (0:00:27.900) 0:02:21.178 **** 2021-02-10T23:36:23.700 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-02-10T23:36:23.702 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-02-10T23:36:23.735 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:23 +0000 (0:00:00.641) 0:02:21.819 **** 2021-02-10T23:36:33.924 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-02-10T23:36:33.926 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:10.037662", "end": "2021-02-10 23:36:33.905780", "failed_when_result": false, "rc": 0, "start": "2021-02-10 23:36:23.868118", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-02-10T23:36:33.958 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:33 +0000 (0:00:10.223) 0:02:32.043 **** 2021-02-10T23:36:34.321 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-02-10T23:36:34.357 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:34 +0000 (0:00:00.398) 0:02:32.441 **** 2021-02-10T23:36:34.531 INFO:teuthology.task.ansible.out: 2021-02-10T23:36:34.532 INFO:teuthology.task.ansible.out:TASK [common : nrpe - Compile SELinux module file] ***************************** changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.020770", "end": "2021-02-10 23:36:34.511114", "rc": 0, "start": "2021-02-10 23:36:34.490344", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:36:34.568 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:34 +0000 (0:00:00.211) 0:02:32.653 **** 2021-02-10T23:36:34.721 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-02-10T23:36:34.723 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.008510", "end": "2021-02-10 23:36:34.709299", "rc": 0, "start": "2021-02-10 23:36:34.700789", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:36:34.756 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:34 +0000 (0:00:00.187) 0:02:32.840 **** 2021-02-10T23:36:44.925 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-02-10T23:36:44.927 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:10.018339", "end": "2021-02-10 23:36:44.905258", "rc": 0, "start": "2021-02-10 23:36:34.886919", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:36:44.967 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:44 +0000 (0:00:10.211) 0:02:43.052 **** 2021-02-10T23:36:45.131 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-02-10T23:36:45.133 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-02-10T23:36:45.172 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.204) 0:02:43.256 **** 2021-02-10T23:36:45.210 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-02-10T23:36:45.211 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-02-10T23:36:45.244 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.072) 0:02:43.329 **** 2021-02-10T23:36:45.282 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-02-10T23:36:45.283 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-10T23:36:45.317 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.073) 0:02:43.402 **** 2021-02-10T23:36:45.355 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-02-10T23:36:45.356 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "redhat-lsb", "firewalld", "wget", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "make", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2021-02-10T23:36:45.391 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.073) 0:02:43.475 **** 2021-02-10T23:36:45.428 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-02-10T23:36:45.429 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-02-10T23:36:45.463 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.071) 0:02:43.547 **** 2021-02-10T23:36:45.609 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-02-10T23:36:45.611 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-02-10T23:36:45.643 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.179) 0:02:43.727 **** 2021-02-10T23:36:45.795 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-02-10T23:36:45.797 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2021-02-10T23:36:45.829 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.186) 0:02:43.914 **** 2021-02-10T23:36:45.857 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-02-10T23:36:45.859 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:45.891 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.061) 0:02:43.975 **** 2021-02-10T23:36:45.917 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-02-10T23:36:45.919 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:45.952 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:45 +0000 (0:00:00.060) 0:02:44.036 **** 2021-02-10T23:36:46.115 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-02-10T23:36:46.388 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} Wednesday 10 February 2021 23:36:46 +0000 (0:00:00.199) 0:02:44.235 **** 2021-02-10T23:36:46.585 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-02-10T23:36:46.587 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-02-10T23:36:46.619 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:46 +0000 (0:00:00.468) 0:02:44.703 **** 2021-02-10T23:36:46.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-02-10T23:36:46.647 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba001"}, "changed": false} 2021-02-10T23:36:46.679 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:46 +0000 (0:00:00.060) 0:02:44.764 **** 2021-02-10T23:36:47.605 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-02-10T23:36:47.786 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "gibba001", "ansible_hostname": "gibba001", "ansible_nodename": "gibba001"}, "changed": false, "name": "gibba001"} Wednesday 10 February 2021 23:36:47 +0000 (0:00:00.960) 0:02:45.724 **** 2021-02-10T23:36:47.990 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-02-10T23:36:47.992 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-02-10T23:36:48.024 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:48 +0000 (0:00:00.384) 0:02:46.108 **** 2021-02-10T23:36:48.408 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-02-10T23:36:48.961 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:48 +0000 (0:00:00.419) 0:02:46.527 **** 2021-02-10T23:36:48.981 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-02-10T23:36:48.984 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-02-10T23:36:49.016 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:49 +0000 (0:00:00.572) 0:02:47.100 **** 2021-02-10T23:36:49.375 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-02-10T23:36:49.376 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-02-10T23:36:49.411 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:49 +0000 (0:00:00.395) 0:02:47.495 **** 2021-02-10T23:36:49.563 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-10T23:36:49.564 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-10T23:36:49.596 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:49 +0000 (0:00:00.185) 0:02:47.681 **** 2021-02-10T23:36:49.748 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-10T23:36:49.750 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-02-10T23:36:49.783 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:49 +0000 (0:00:00.186) 0:02:47.867 **** 2021-02-10T23:36:49.945 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-10T23:36:49.946 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-02-10T23:36:49.979 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:49 +0000 (0:00:00.196) 0:02:48.063 **** 2021-02-10T23:36:50.349 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-10T23:36:50.349 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-02-10T23:36:50.396 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:50 +0000 (0:00:00.417) 0:02:48.481 **** 2021-02-10T23:36:50.755 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-02-10T23:36:50.756 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-02-10T23:36:50.790 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:50 +0000 (0:00:00.393) 0:02:48.874 **** 2021-02-10T23:36:52.650 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-02-10T23:36:52.651 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.713472", "end": "2021-02-10 23:36:52.634883", "rc": 0, "start": "2021-02-10 23:36:50.921411", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:36:52.688 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:52 +0000 (0:00:01.898) 0:02:50.772 **** 2021-02-10T23:36:52.716 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-02-10T23:36:52.718 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:52.763 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:52 +0000 (0:00:00.074) 0:02:50.847 **** 2021-02-10T23:36:53.136 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-02-10T23:36:53.137 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-02-10T23:36:53.173 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.410) 0:02:51.257 **** 2021-02-10T23:36:53.200 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-02-10T23:36:53.234 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.061) 0:02:51.318 **** 2021-02-10T23:36:53.261 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-02-10T23:36:53.296 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.062) 0:02:51.381 **** 2021-02-10T23:36:53.323 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-02-10T23:36:53.324 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.357 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.060) 0:02:51.441 **** 2021-02-10T23:36:53.395 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-02-10T23:36:53.396 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.406 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.440 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.082) 0:02:51.524 **** 2021-02-10T23:36:53.466 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-02-10T23:36:53.467 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.500 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.060) 0:02:51.584 **** 2021-02-10T23:36:53.526 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:36:53.527 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.560 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.060) 0:02:51.644 **** 2021-02-10T23:36:53.597 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-02-10T23:36:53.599 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.632 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.071) 0:02:51.716 **** 2021-02-10T23:36:53.668 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-02-10T23:36:53.670 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.703 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.071) 0:02:51.788 **** 2021-02-10T23:36:53.855 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-02-10T23:36:53.856 INFO:teuthology.task.ansible.out:fatal: [gibba001.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005213", "end": "2021-02-10 23:36:53.843812", "msg": "non-zero return code", "rc": 1, "start": "2021-02-10 23:36:53.838599", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-02-10T23:36:53.891 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.187) 0:02:51.975 **** 2021-02-10T23:36:53.928 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-02-10T23:36:53.930 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:36:53.962 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:53 +0000 (0:00:00.071) 0:02:52.047 **** 2021-02-10T23:36:58.679 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-02-10T23:36:58.680 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2021-02-10T23:36:58.727 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:36:58 +0000 (0:00:04.764) 0:02:56.811 **** 2021-02-10T23:37:03.014 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-02-10T23:37:03.015 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-02-10T23:37:03.052 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:03 +0000 (0:00:04.325) 0:03:01.137 **** 2021-02-10T23:37:38.886 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-02-10T23:37:38.887 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: redhat-lsb", "Installed: firewalld", "Installed: wget", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: make", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: urw-base35-p052-fonts-20170801-10.el8.noarch", "Installed: urw-base35-nimbus-roman-fonts-20170801-10.el8.noarch", "Installed: perl-B-Lint-1.20-11.el8.noarch", "Installed: perl-Text-Unidecode-1.30-5.el8.noarch", "Installed: perl-XML-NamespaceSupport-1.12-4.el8.noarch", "Installed: urw-base35-z003-fonts-20170801-10.el8.noarch", "Installed: avahi-0.7-19.el8.x86_64", "Installed: libidn-1.34-5.el8.x86_64", "Installed: perl-Module-Runtime-0.016-2.el8.noarch", "Installed: perl-Pod-Plainer-1.04-7.el8.noarch", "Installed: perl-HTTP-Cookies-6.04-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: libICE-1.0.9-15.el8.x86_64", "Installed: xorg-x11-server-utils-7.7-27.el8.x86_64", "Installed: qpdf-libs-7.1.1-10.el8.x86_64", "Installed: openjpeg2-2.3.1-6.el8.x86_64", "Installed: openssl-libs-1:1.1.1g-12.el8_3.x86_64", "Installed: urw-base35-gothic-fonts-20170801-10.el8.noarch", "Installed: libpng12-1.2.57-5. 2021-02-10T23:37:38.889 INFO:teuthology.task.ansible.out:el8.x86_64", "Installed: cups-ipptool-1:2.2.6-38.el8.x86_64", "Installed: openssl-1:1.1.1g-12.el8_3.x86_64", "Installed: libmcpp-2.7.2-20.el8.x86_64", "Installed: urw-base35-nimbus-mono-ps-fonts-20170801-10.el8.noarch", "Installed: redhat-lsb-4.1-47.el8.x86_64", "Installed: libijs-0.35-5.el8.x86_64", "Installed: urw-base35-fonts-20170801-10.el8.noarch", "Installed: perl-libwww-perl-6.34-1.module+el8.3.0+6498+9eecfe51.noarch", "Installed: lcms2-2.9-2.el8.x86_64", "Installed: urw-base35-d050000l-fonts-20170801-10.el8.noarch", "Installed: perl-Class-ISA-0.36-1022.el8.noarch", "Installed: poppler-data-0.4.9-1.el8.noarch", "Installed: mcpp-2.7.2-20.el8.x86_64", "Installed: perl-XML-LibXML-1:2.0132-2.el8.x86_64", "Installed: liberation-mono-fonts-1:2.00.3-7.el8.noarch", "Installed: perl-Data-Dump-1.23-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: urw-base35-standard-symbols-ps-fonts-20170801-10.el8.noarch", "Installed: google-droid-sans-fonts-20120715-13.el8.noarch", "Installed: perl-Try-Tiny-0.30-7.module+el8.3.0+6498+9eecfe51.noarch", "Installed: perl-WWW-RobotRules-6.02-18.module+el8.3.0+6498+9eecfe51.noarch", "Installed: perl-Text-Soundex-3.05-8.el8.x86_64", "Installed: jbig2dec-libs-0.14-4.el8_2.x86_64", "Installed: libSM-1.2.3-1.el8.x86_64", "Installed: perl-XML-SAX-1.00-1.el8.noarch", "Installed: qemu-img-15:4.2.0-34.module+el8.3.0+8829+e7a0a3ea.1.x86_64", "Installed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+8829+e7a0a3ea.1.x86_64", "Installed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+8829+e7a0a3ea.1.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: redhat-lsb-languages-4.1-47.el8.x86_64", "Installed: poppler-utils-0.66.0-27.el8.x86_64", "Installed: cups-1:2.2.6-38.el8.x86_64", "Installed: perl-HTTP-Negotiate-6.01-19.module+el8.3.0+6498+9eecfe51.noarch", "Installed: redhat-lsb-desktop-4.1-47.el8.x86_64", "Installed: urw-base35-c059-fonts-20170801-10.el8.noarch", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+8829+e7a0a 2021-02-10T23:37:38.890 INFO:teuthology.task.ansible.out:3ea.1.x86_64", "Installed: urw-base35-bookman-fonts-20170801-10.el8.noarch", "Installed: perl-NTLM-1.09-17.module+el8.3.0+6498+9eecfe51.noarch", "Installed: libpaper-1.1.24-22.el8.x86_64", "Installed: perl-Module-Pluggable-2:5.2-7.el8.noarch", "Installed: poppler-0.66.0-27.el8.x86_64", "Installed: cups-filters-libs-1.20.0-20.el8.x86_64", "Installed: perl-File-CheckTree-4.42-303.el8.noarch", "Installed: liberation-fonts-common-1:2.00.3-7.el8.noarch", "Installed: urw-base35-nimbus-sans-fonts-20170801-10.el8.noarch", "Installed: perl-Pod-LaTeX-0.61-302.el8.noarch", "Installed: redhat-lsb-cxx-4.1-47.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: libgs-9.25-7.el8.x86_64", "Installed: mesa-libGLU-9.0.0-15.el8.x86_64", "Installed: libXxf86misc-1.0.4-1.el8.x86_64", "Installed: libXt-1.1.5-12.el8.x86_64", "Installed: libXmu-1.1.3-1.el8.x86_64", "Installed: adobe-mappings-pdf-20180407-1.el8.noarch", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: perl-XML-SAX-Base-1.09-4.el8.noarch", "Installed: adobe-mappings-cmap-20171205-3.el8.noarch", "Installed: cups-filesystem-1:2.2.6-38.el8.noarch", "Installed: adobe-mappings-cmap-deprecated-20171205-3.el8.noarch", "Installed: urw-base35-fonts-common-20170801-10.el8.noarch", "Installed: avahi-glib-0.7-19.el8.x86_64", "Installed: ghostscript-9.25-7.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: cups-filters-1.20.0-20.el8.x86_64", "Installed: perl-Net-HTTP-6.17-2.module+el8.3.0+6498+9eecfe51.noarch", "Installed: redhat-lsb-printing-4.1-47.el8.x86_64", "Installed: redhat-lsb-submod-multimedia-4.1-47.el8.x86_64", "Installed: perl-File-Listing-6.04-17.module+el8.3.0+6498+9eecfe51.noarch", "Removed: qemu-img-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-common-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: qemu-kvm-core-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Removed: openssl-1:1.1.1g-11.el8.x86_64", "Removed: openssl-libs-1:1.1.1g-11.el8 2021-02-10T23:37:38.892 INFO:teuthology.task.ansible.out:.x86_64"]} 2021-02-10T23:37:38.922 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:38 +0000 (0:00:35.869) 0:03:37.006 **** 2021-02-10T23:37:40.872 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-02-10T23:37:40.874 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2021-02-10T23:37:40.906 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:40 +0000 (0:00:01.984) 0:03:38.991 **** 2021-02-10T23:37:42.801 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-02-10T23:37:42.803 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-02-10T23:37:42.846 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:42 +0000 (0:00:01.939) 0:03:40.931 **** 2021-02-10T23:37:42.884 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-10T23:37:42.885 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:42.918 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:42 +0000 (0:00:00.072) 0:03:41.003 **** 2021-02-10T23:37:43.155 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-02-10T23:37:43.156 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.service sysinit.target system.slice polkit.service basic.target dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ipset.service nftables.service ip6tables.service iptables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "De 2021-02-10T23:37:43.157 INFO:teuthology.task.ansible.out:vicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limit 2021-02-10T23:37:43.159 INFO:teuthology.task.ansible.out:NOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "St 2021-02-10T23:37:43.160 INFO:teuthology.task.ansible.out:artLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-02-10T23:37:43.192 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:43 +0000 (0:00:00.273) 0:03:41.276 **** 2021-02-10T23:37:43.416 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-02-10T23:37:43.417 INFO:teuthology.task.ansible.out:fatal: [gibba001.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-02-10T23:37:43.451 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:43 +0000 (0:00:00.258) 0:03:41.535 **** 2021-02-10T23:37:44.215 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-02-10T23:37:44.249 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.798) 0:03:42.333 **** 2021-02-10T23:37:44.275 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-02-10T23:37:44.277 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:44.310 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.060) 0:03:42.394 **** 2021-02-10T23:37:44.336 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-02-10T23:37:44.338 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:44.370 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.060) 0:03:42.455 **** 2021-02-10T23:37:44.407 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-02-10T23:37:44.408 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:44.441 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.070) 0:03:42.526 **** 2021-02-10T23:37:44.467 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-02-10T23:37:44.469 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:44.501 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.060) 0:03:42.586 **** 2021-02-10T23:37:44.706 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.059) 0:03:42.645 **** TASK [testnode : Check for custom repos] *************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.061) 0:03:42.707 **** TASK [testnode : Remove custom repos] ****************************************** Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.060) 0:03:42.768 **** 2021-02-10T23:37:44.709 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-02-10T23:37:44.711 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:44.743 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.059) 0:03:42.828 **** 2021-02-10T23:37:44.770 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-02-10T23:37:45.017 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.060) 0:03:42.888 **** TASK [testnode : Install apt keys] ********************************************* skipping: [gibba001.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.072) 0:03:42.961 **** TASK [testnode : Install python-apt] ******************************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.059) 0:03:43.020 **** TASK [testnode : Add local apt repos.] ***************************************** Wednesday 10 February 2021 23:37:44 +0000 (0:00:00.063) 0:03:43.084 **** 2021-02-10T23:37:45.026 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-02-10T23:37:45.027 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.059 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.144 **** 2021-02-10T23:37:45.086 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-02-10T23:37:45.087 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.119 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.203 **** 2021-02-10T23:37:45.154 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-02-10T23:37:45.156 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.190 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.071) 0:03:43.275 **** 2021-02-10T23:37:45.217 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-10T23:37:45.218 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.249 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.334 **** 2021-02-10T23:37:45.464 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.394 **** TASK [testnode : Install packages] ********************************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.060) 0:03:43.454 **** TASK [testnode : Install non aarch64 packages] ********************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.070) 0:03:43.524 **** 2021-02-10T23:37:45.466 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-02-10T23:37:45.468 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.500 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.584 **** 2021-02-10T23:37:45.525 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-02-10T23:37:45.527 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.560 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.644 **** 2021-02-10T23:37:45.858 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.059) 0:03:43.704 **** TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.057) 0:03:43.762 **** TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.057) 0:03:43.819 **** TASK [testnode : Set up static IP in /etc/hosts.] ****************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.056) 0:03:43.876 **** TASK [testnode : Stop apache2] ************************************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.057) 0:03:43.934 **** 2021-02-10T23:37:45.875 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-02-10T23:37:45.877 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.908 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.058) 0:03:43.993 **** 2021-02-10T23:37:45.935 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-02-10T23:37:45.936 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:45.969 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:45 +0000 (0:00:00.060) 0:03:44.053 **** 2021-02-10T23:37:45.996 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-02-10T23:37:45.997 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.032 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.062) 0:03:44.116 **** 2021-02-10T23:37:46.058 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-02-10T23:37:46.059 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.092 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.059) 0:03:44.176 **** 2021-02-10T23:37:46.386 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.069) 0:03:44.245 **** TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.304 **** TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.362 **** TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.060) 0:03:44.422 **** TASK [testnode : set_fact] ***************************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.396 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.481 **** 2021-02-10T23:37:46.422 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.455 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.539 **** 2021-02-10T23:37:46.481 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.514 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.059) 0:03:44.598 **** 2021-02-10T23:37:46.540 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-02-10T23:37:46.542 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.572 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.656 **** 2021-02-10T23:37:46.601 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.783 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.061) 0:03:44.718 **** TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.060) 0:03:44.778 **** TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.837 **** TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.811 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.058) 0:03:44.895 **** 2021-02-10T23:37:46.838 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-10T23:37:46.839 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.871 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.060) 0:03:44.956 **** 2021-02-10T23:37:46.910 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:46.947 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:46 +0000 (0:00:00.075) 0:03:45.031 **** 2021-02-10T23:37:46.984 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.017 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.070) 0:03:45.102 **** 2021-02-10T23:37:47.044 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-10T23:37:47.045 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.077 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.059) 0:03:45.161 **** 2021-02-10T23:37:47.104 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-10T23:37:47.105 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.147 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.069) 0:03:45.231 **** 2021-02-10T23:37:47.175 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-10T23:37:47.176 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.209 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.062) 0:03:45.294 **** 2021-02-10T23:37:47.237 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-02-10T23:37:47.238 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.271 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.061) 0:03:45.355 **** 2021-02-10T23:37:47.298 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-02-10T23:37:47.299 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.335 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.063) 0:03:45.419 **** 2021-02-10T23:37:47.362 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-02-10T23:37:47.364 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.400 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.065) 0:03:45.485 **** 2021-02-10T23:37:47.427 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-02-10T23:37:47.429 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.462 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.061) 0:03:45.546 **** 2021-02-10T23:37:47.488 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-02-10T23:37:47.490 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.523 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.061) 0:03:45.608 **** 2021-02-10T23:37:47.550 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-02-10T23:37:47.552 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.584 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.060) 0:03:45.668 **** 2021-02-10T23:37:47.612 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.645 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.061) 0:03:45.730 **** 2021-02-10T23:37:47.671 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-02-10T23:37:47.673 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.705 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.059) 0:03:45.790 **** 2021-02-10T23:37:47.732 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.766 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.060) 0:03:45.850 **** 2021-02-10T23:37:47.803 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-02-10T23:37:47.804 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.839 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.073) 0:03:45.924 **** 2021-02-10T23:37:47.865 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-02-10T23:37:47.867 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.900 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.060) 0:03:45.984 **** 2021-02-10T23:37:47.926 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-02-10T23:37:47.928 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:47.961 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:47 +0000 (0:00:00.061) 0:03:46.046 **** 2021-02-10T23:37:47.988 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-02-10T23:37:47.989 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.021 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.060) 0:03:46.106 **** 2021-02-10T23:37:48.049 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-02-10T23:37:48.050 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.082 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.060) 0:03:46.166 **** 2021-02-10T23:37:48.108 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-02-10T23:37:48.110 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.142 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.060) 0:03:46.226 **** 2021-02-10T23:37:48.168 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-02-10T23:37:48.170 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.203 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.061) 0:03:46.287 **** 2021-02-10T23:37:48.242 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:37:48.244 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-02-10T23:37:48.294 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.090) 0:03:46.378 **** 2021-02-10T23:37:48.335 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-02-10T23:37:48.336 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.346 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-02-10T23:37:48.356 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.367 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.367 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.378 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.379 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.417 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.123) 0:03:46.502 **** 2021-02-10T23:37:48.755 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-02-10T23:37:48.756 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006812", "end": "2021-02-10 23:37:48.727444", "rc": 0, "start": "2021-02-10 23:37:48.720632", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/bin/teuthology-lock"]} 2021-02-10T23:37:48.793 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.375) 0:03:46.878 **** 2021-02-10T23:37:48.820 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-02-10T23:37:48.821 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.857 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.064) 0:03:46.942 **** 2021-02-10T23:37:48.884 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-02-10T23:37:48.885 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:48.924 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.066) 0:03:47.009 **** 2021-02-10T23:37:48.962 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-02-10T23:37:48.963 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:49.000 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:48 +0000 (0:00:00.075) 0:03:47.084 **** 2021-02-10T23:37:49.026 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-02-10T23:37:49.028 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:49.062 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:49 +0000 (0:00:00.061) 0:03:47.146 **** 2021-02-10T23:37:50.975 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-02-10T23:37:50.977 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2021-02-10T23:37:51.010 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:51 +0000 (0:00:01.947) 0:03:49.094 **** 2021-02-10T23:37:51.047 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-10T23:37:51.049 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419802112, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153272, 'block_used': 12941836, 'inode_total': 61054976, 'inode_available': 60986956, 'inode_used': 68020, 'uuid': '3b6f09d8-1f6d-44b1-8eae-585ac69873c0'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153272, "block_size": 4096, "block_total": 240095108, "block_used": 12941836, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986956, "inode_total": 61054976, "inode_used": 68020, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419802112, "size_total": 983429562368, "uuid": "3b6f09d8-1f6d-44b1-8eae-585ac69873c0"}} 2021-02-10T23:37:51.083 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:51 +0000 (0:00:00.073) 0:03:49.167 **** 2021-02-10T23:37:51.237 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-02-10T23:37:51.237 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003523", "end": "2021-02-10 23:37:51.223104", "rc": 0, "start": "2021-02-10 23:37:51.219581", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:37:51.272 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:51 +0000 (0:00:00.189) 0:03:49.357 **** 2021-02-10T23:37:51.310 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-02-10T23:37:51.311 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419802112, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153272, 'block_used': 12941836, 'inode_total': 61054976, 'inode_available': 60986956, 'inode_used': 68020, 'uuid': '3b6f09d8-1f6d-44b1-8eae-585ac69873c0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153272, "block_size": 4096, "block_total": 240095108, "block_used": 12941836, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986956, "inode_total": 61054976, "inode_used": 68020, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419802112, "size_total": 983429562368, "uuid": "3b6f09d8-1f6d-44b1-8eae-585ac69873c0"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:51.345 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:51 +0000 (0:00:00.072) 0:03:49.429 **** 2021-02-10T23:37:51.372 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-02-10T23:37:51.406 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:51 +0000 (0:00:00.060) 0:03:49.490 **** 2021-02-10T23:37:53.511 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-02-10T23:37:53.513 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyQKqGwnHlZSnVz2XeXOtqPg9PpfDhnha7'], 'uuids': ['097a28f8-af6c-4c61-977c-2e92db186c06'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.911955", "end": "2021-02-10 23:37:53.489362", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyQKqGwnHlZSnVz2XeXOtqPg9PpfDhnha7"], "labels": [], "masters": [], "uuids": ["097a28f8-af6c-4c61-977c-2e92db186c06"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:51.577407", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:54.700 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-PwK0sj-EaP4-RSHc-fXfZ-Z8ex-MokG-XBO4CU', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008P375A', 'nvme-nvme.8086-50484b4d393230303030385033373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.057393", "end": "2021-02-10 23:37:54.684029", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-PwK0sj-EaP4-RSHc-fXfZ-Z8ex-MokG-XBO4CU", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008P375A", "nvme-nvme.8086-50484b4d393230303030385033373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:53.626636", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-02-10T23:37:54.702 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:55.884 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyE6bkbMV3sJdXLpxbfN9dpT89vjRJipSP'], 'uuids': ['a1174ec3-6f2f-49fe-906c-2742cd6608df'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.047794", "end": "2021-02-10 23:37:55.868901", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyE6bkbMV3sJdXLpxbfN9dpT89vjRJipSP"], "labels": [], "masters": [], "uuids": ["a1174ec3-6f2f-49fe-906c-2742cd6608df"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:54.821107", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:57.084 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyCesBFFKIoC7xTXgc6xjs1GCHKTZ6x1VN'], 'uuids': ['6c16f5c3-36c3-4cec-bf72-cd0c66275309'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.056512", "end": "2021-02-10 23:37:57.061120", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyCesBFFKIoC7xTXgc6xjs1GCHKTZ6x1VN"], "labels": [], "masters": [], "uuids": ["6c16f5c3-36c3-4cec-bf72-cd0c66275309"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:56.004608", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:58.281 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vny5mvXIZbF2wyUuqhKO9g0bIZ8OZHxBkKk'], 'uuids': ['d2e4e048-717e-4a8c-9a75-7417e66365eb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.052137", "end": "2021-02-10 23:37:58.261695", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vny5mvXIZbF2wyUuqhKO9g0bIZ8OZHxBkKk"], "labels": [], "masters": [], "uuids": ["d2e4e048-717e-4a8c-9a75-7417e66365eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:57.209558", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:58.293 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF', 'scsi-350000399ab801df6', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF', 'wwn-0x50000399ab801df6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I3K2IYF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab801df6', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1', 'scsi-350000399ab801df6-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1', 'wwn-0x50000399ab801df6-part1'], 'uuids': ['3b6f09d8-1f6d-44b1-8eae-585ac69873c0'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '3b6f09d8-1f6d-44b1-8eae-585ac69873c0', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF", "scsi-350000399ab801df6", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF", "wwn-0x50000399ab801df6"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1", "scsi-1ATA_TOSHI 2021-02-10T23:37:58.294 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I3K2IYF6XF-part1", "scsi-350000399ab801df6-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1", "wwn-0x50000399ab801df6-part1"], "labels": [], "masters": [], "uuids": ["3b6f09d8-1f6d-44b1-8eae-585ac69873c0"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "3b6f09d8-1f6d-44b1-8eae-585ac69873c0"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K2IYF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801df6"}}, "skip_reason": "Conditional result was False"} 2021-02-10T23:37:59.496 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyurYLpXgMWHULpetYJRmU5lIQNc2Y2h3c'], 'uuids': ['2146b52c-3c23-4121-9a00-7af8116f593a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.066277", "end": "2021-02-10 23:37:59.472055", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyurYLpXgMWHULpetYJRmU5lIQNc2Y2h3c"], "labels": [], "masters": [], "uuids": ["2146b52c-3c23-4121-9a00-7af8116f593a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:58.405778", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-02-10T23:37:59.536 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:37:59 +0000 (0:00:08.130) 0:03:57.620 **** 2021-02-10T23:37:59.793 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-02-10T23:37:59.794 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyQKqGwnHlZSnVz2XeXOtqPg9PpfDhnha7'], 'uuids': ['097a28f8-af6c-4c61-977c-2e92db186c06'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.077369", "end": "2021-02-10 23:37:59.763976", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyQKqGwnHlZSnVz2XeXOtqPg9PpfDhnha7"], "labels": [], "masters": [], "uuids": ["097a28f8-af6c-4c61-977c-2e92db186c06"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:59.686607", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0757185 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0757185 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:37:59.951 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-PwK0sj-EaP4-RSHc-fXfZ-Z8ex-MokG-XBO4CU', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200008P375A', 'nvme-nvme.8086-50484b4d393230303030385033373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.024703", "end": "2021-02-10 23:37:59.935119", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-PwK0sj-EaP4-RSHc-fXfZ-Z8ex-MokG-XBO4CU", "nvme-INTEL_SSDPEL1K375GA_PHKM9200008P375A", "nvme-nvme.8086-50484b4d393230303030385033373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:37:59.910416", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0230666 s, 5.0 GB/s", "stderr_lines": ["1 2021-02-10T23:37:59.953 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0230666 s, 5.0 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:00.172 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyE6bkbMV3sJdXLpxbfN9dpT89vjRJipSP'], 'uuids': ['a1174ec3-6f2f-49fe-906c-2742cd6608df'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.076818", "end": "2021-02-10 23:38:00.149090", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyE6bkbMV3sJdXLpxbfN9dpT89vjRJipSP"], "labels": [], "masters": [], "uuids": ["a1174ec3-6f2f-49fe-906c-2742cd6608df"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:38:00.072272", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0750389 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0750389 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:00.380 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyCesBFFKIoC7xTXgc6xjs1GCHKTZ6x1VN'], 'uuids': ['6c16f5c3-36c3-4cec-bf72-cd0c66275309'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.077344", "end": "2021-02-10 23:38:00.359760", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyCesBFFKIoC7xTXgc6xjs1GCHKTZ6x1VN"], "labels": [], "masters": [], "uuids": ["6c16f5c3-36c3-4cec-bf72-cd0c66275309"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:38:00.282416", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0756857 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0756857 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:00.588 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vny5mvXIZbF2wyUuqhKO9g0bIZ8OZHxBkKk'], 'uuids': ['d2e4e048-717e-4a8c-9a75-7417e66365eb'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.077878", "end": "2021-02-10 23:38:00.571346", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vny5mvXIZbF2wyUuqhKO9g0bIZ8OZHxBkKk"], "labels": [], "masters": [], "uuids": ["d2e4e048-717e-4a8c-9a75-7417e66365eb"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:38:00.493468", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0761802 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0761802 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:00.603 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF', 'scsi-350000399ab801df6', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF', 'wwn-0x50000399ab801df6'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I3K2IYF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab801df6', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1', 'scsi-350000399ab801df6-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1', 'wwn-0x50000399ab801df6-part1'], 'uuids': ['3b6f09d8-1f6d-44b1-8eae-585ac69873c0'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '3b6f09d8-1f6d-44b1-8eae-585ac69873c0', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF", "scsi-350000399ab801df6", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF", "wwn-0x50000399ab801df6"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I3K2IYF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1", "scsi-1ATA_TOSHI 2021-02-10T23:38:00.605 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I3K2IYF6XF-part1", "scsi-350000399ab801df6-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I3K2IYF6XF-part1", "wwn-0x50000399ab801df6-part1"], "labels": [], "masters": [], "uuids": ["3b6f09d8-1f6d-44b1-8eae-585ac69873c0"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "3b6f09d8-1f6d-44b1-8eae-585ac69873c0"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I3K2IYF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab801df6"}}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:00.822 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyurYLpXgMWHULpetYJRmU5lIQNc2Y2h3c'], 'uuids': ['2146b52c-3c23-4121-9a00-7af8116f593a'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.077671", "end": "2021-02-10 23:38:00.797789", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-zfcd3sVuBz5ByEOiA7RgNko77vDy2vnyurYLpXgMWHULpetYJRmU5lIQNc2Y2h3c"], "labels": [], "masters": [], "uuids": ["2146b52c-3c23-4121-9a00-7af8116f593a"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-02-10 23:38:00.720118", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0760725 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0760725 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:00.863 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:00 +0000 (0:00:01.327) 0:03:58.948 **** 2021-02-10T23:38:01.097 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-02-10T23:38:01.098 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.071637", "end": "2021-02-10 23:38:01.071781", "rc": 0, "start": "2021-02-10 23:38:01.000144", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:01.137 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.273) 0:03:59.221 **** 2021-02-10T23:38:01.329 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-02-10T23:38:01.331 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.046782", "end": "2021-02-10 23:38:01.311556", "rc": 0, "start": "2021-02-10 23:38:01.264774", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:01.363 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.226) 0:03:59.447 **** 2021-02-10T23:38:01.390 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-02-10T23:38:01.425 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.061) 0:03:59.509 **** 2021-02-10T23:38:01.462 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-02-10T23:38:01.464 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:01.502 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.076) 0:03:59.586 **** 2021-02-10T23:38:01.537 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-02-10T23:38:01.539 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:01.574 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.072) 0:03:59.659 **** 2021-02-10T23:38:01.602 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-10T23:38:01.603 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:01.639 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.064) 0:03:59.723 **** 2021-02-10T23:38:01.676 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-02-10T23:38:01.678 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:01.710 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.071) 0:03:59.794 **** 2021-02-10T23:38:01.864 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-02-10T23:38:01.866 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-02-10T23:38:01.898 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.187) 0:03:59.982 **** 2021-02-10T23:38:01.936 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-02-10T23:38:01.937 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930419802112, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153272, 'block_used': 12941836, 'inode_total': 61054976, 'inode_available': 60986956, 'inode_used': 68020, 'uuid': '3b6f09d8-1f6d-44b1-8eae-585ac69873c0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153272, "block_size": 4096, "block_total": 240095108, "block_used": 12941836, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986956, "inode_total": 61054976, "inode_used": 68020, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930419802112, "size_total": 983429562368, "uuid": "3b6f09d8-1f6d-44b1-8eae-585ac69873c0"}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:01.971 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:01 +0000 (0:00:00.072) 0:04:00.055 **** 2021-02-10T23:38:02.009 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-02-10T23:38:02.010 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.042 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.071) 0:04:00.126 **** 2021-02-10T23:38:02.069 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:38:02.071 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.103 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.061) 0:04:00.188 **** 2021-02-10T23:38:02.129 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:38:02.131 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.164 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.060) 0:04:00.248 **** 2021-02-10T23:38:02.191 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-02-10T23:38:02.192 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.225 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.061) 0:04:00.309 **** 2021-02-10T23:38:02.251 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-02-10T23:38:02.253 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.285 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.060) 0:04:00.370 **** 2021-02-10T23:38:02.312 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-02-10T23:38:02.313 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:02.345 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:02 +0000 (0:00:00.059) 0:04:00.430 **** 2021-02-10T23:38:03.016 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-02-10T23:38:03.016 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-02-10T23:38:03.051 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:03 +0000 (0:00:00.704) 0:04:01.134 **** 2021-02-10T23:38:03.601 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-02-10T23:38:03.602 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-10T23:38:03.905 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-10T23:38:04.195 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-10T23:38:04.474 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-10T23:38:04.744 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-02-10T23:38:04.779 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:04 +0000 (0:00:01.729) 0:04:02.863 **** 2021-02-10T23:38:04.930 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-02-10T23:38:04.931 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-02-10T23:38:04.965 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:04 +0000 (0:00:00.185) 0:04:03.049 **** 2021-02-10T23:38:05.137 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-02-10T23:38:05.139 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-10T23:38:05.263 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-10T23:38:05.399 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-10T23:38:05.534 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-02-10T23:38:05.546 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:05.603 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:05 +0000 (0:00:00.638) 0:04:03.688 **** 2021-02-10T23:38:05.630 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-02-10T23:38:05.632 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:05.665 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:05 +0000 (0:00:00.061) 0:04:03.750 **** 2021-02-10T23:38:05.704 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-02-10T23:38:05.705 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:05.737 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:05 +0000 (0:00:00.071) 0:04:03.821 **** 2021-02-10T23:38:05.893 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-02-10T23:38:07.121 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} Wednesday 10 February 2021 23:38:05 +0000 (0:00:00.189) 0:04:04.011 **** TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:05 +0000 (0:00:00.062) 0:04:04.074 **** TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [gibba001.front.sepia.ceph.com] => {"changed": true} Wednesday 10 February 2021 23:38:06 +0000 (0:00:00.481) 0:04:04.555 **** TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} Wednesday 10 February 2021 23:38:06 +0000 (0:00:00.529) 0:04:05.084 **** TASK [testnode : Install cachefilesd] ****************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.071) 0:04:05.156 **** TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.133 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.061) 0:04:05.218 **** 2021-02-10T23:38:07.619 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.060) 0:04:05.278 **** TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.059) 0:04:05.337 **** TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.057) 0:04:05.394 **** TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.061) 0:04:05.456 **** TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.087) 0:04:05.544 **** TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.076) 0:04:05.621 **** TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.632 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.095) 0:04:05.716 **** 2021-02-10T23:38:07.661 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-02-10T23:38:07.662 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.695 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.062) 0:04:05.779 **** 2021-02-10T23:38:07.731 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.771 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.076) 0:04:05.855 **** 2021-02-10T23:38:07.811 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.848 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.077) 0:04:05.933 **** 2021-02-10T23:38:07.878 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-02-10T23:38:07.880 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.917 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.066) 0:04:06.000 **** 2021-02-10T23:38:07.947 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-02-10T23:38:07.949 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:07.982 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:07 +0000 (0:00:00.066) 0:04:06.066 **** 2021-02-10T23:38:08.010 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-02-10T23:38:08.012 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:08.044 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.062) 0:04:06.128 **** 2021-02-10T23:38:08.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-02-10T23:38:08.407 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-02-10T23:38:08.439 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.395) 0:04:06.524 **** 2021-02-10T23:38:08.677 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-02-10T23:38:08.678 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2021-02-10 23:32:56 UTC", "ActiveEnterTimestampMonotonic": "13478107", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount -.mount ntpdate.service systemd-tmpfiles-setup.service sntp.service systemd-journald.socket sysinit.target ntpd.service basic.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2021-02-10 23:32:55 UTC", "AssertTimestampMonotonic": "11840584", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2021-02-10 23:32:55 UTC", "ConditionTimestampMonotonic": "11840569", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGrou 2021-02-10T23:38:08.680 INFO:teuthology.task.ansible.out:p": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1014", "ExecMainStartTimestamp": "Wed 2021-02-10 23:32:55 UTC", "ExecMainStartTimestampMonotonic": "12208780", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2021-02-10 23:32:55 UTC", "InactiveExitTimestampMonotonic": "11923523", "InvocationID": "aa5ae1c9b99c453780b3c80b48d0614d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity" 2021-02-10T23:38:08.681 INFO:teuthology.task.ansible.out:, "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127285", "LimitNPROCSoft": "127285", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127285", "LimitSIGPENDINGSoft": "127285", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1014", "MemoryAccounting": "yes", "MemoryCurrent": "3690496", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount system.slice sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "n 2021-02-10T23:38:08.682 INFO:teuthology.task.ansible.out:o", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2021-02-10 23:32:56 UTC", "StateChangeTimestampMonotonic": "13478107", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203656", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2021-02-10 23:32:55 UTC", "WatchdogTimestampMonotonic": "12208787", "WatchdogUSec": "0"}} 2021-02-10T23:38:08.715 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.275) 0:04:06.799 **** 2021-02-10T23:38:08.744 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:38:08.745 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-02-10T23:38:08.798 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.082) 0:04:06.882 **** 2021-02-10T23:38:08.835 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:38:08.836 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-02-10T23:38:08.870 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.071) 0:04:06.954 **** 2021-02-10T23:38:08.896 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-02-10T23:38:08.898 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:08.930 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.060) 0:04:07.014 **** 2021-02-10T23:38:08.957 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:08.990 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:08 +0000 (0:00:00.060) 0:04:07.074 **** 2021-02-10T23:38:09.018 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-02-10T23:38:09.019 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:09.052 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:09 +0000 (0:00:00.062) 0:04:07.137 **** 2021-02-10T23:38:09.211 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-02-10T23:38:09.213 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-02-10T23:38:09.246 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:09 +0000 (0:00:00.193) 0:04:07.331 **** 2021-02-10T23:38:09.650 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-02-10T23:38:09.651 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-02-10T23:38:09.686 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:09 +0000 (0:00:00.439) 0:04:07.770 **** 2021-02-10T23:38:10.761 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-02-10T23:38:10.762 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-02-10T23:38:10.797 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:10 +0000 (0:00:01.110) 0:04:08.881 **** 2021-02-10T23:38:10.823 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-02-10T23:38:10.825 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:10.858 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:10 +0000 (0:00:00.061) 0:04:08.942 **** 2021-02-10T23:38:10.884 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-02-10T23:38:10.886 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-02-10T23:38:10.918 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:10 +0000 (0:00:00.060) 0:04:09.003 **** 2021-02-10T23:38:11.062 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-02-10T23:38:11.064 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-02-10T23:38:11.097 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.178) 0:04:09.181 **** 2021-02-10T23:38:11.127 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-02-10T23:38:11.129 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.165 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.068) 0:04:09.249 **** 2021-02-10T23:38:11.196 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-02-10T23:38:11.197 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-02-10T23:38:11.253 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.088) 0:04:09.338 **** 2021-02-10T23:38:11.281 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-02-10T23:38:11.282 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.314 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.060) 0:04:09.398 **** 2021-02-10T23:38:11.467 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-02-10T23:38:11.469 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-02-10T23:38:11.504 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.190) 0:04:09.589 **** 2021-02-10T23:38:11.656 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-02-10T23:38:11.658 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-02-10T23:38:11.700 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.195) 0:04:09.784 **** 2021-02-10T23:38:11.730 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-02-10T23:38:11.731 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.763 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.063) 0:04:09.848 **** 2021-02-10T23:38:11.803 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-02-10T23:38:11.804 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.814 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.816 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.826 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.859 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.096) 0:04:09.944 **** 2021-02-10T23:38:11.897 INFO:teuthology.task.ansible.out: 2021-02-10T23:38:11.899 INFO:teuthology.task.ansible.out:TASK [testnode : Define net_to_configure var] ********************************** skipping: [gibba001.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba001.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.910 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.911 INFO:teuthology.task.ansible.out: skipping: [gibba001.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.913 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:11.952 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:11 +0000 (0:00:00.092) 0:04:10.037 **** 2021-02-10T23:38:11.979 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-02-10T23:38:11.980 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.016 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.063) 0:04:10.101 **** 2021-02-10T23:38:12.044 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-02-10T23:38:12.045 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.078 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.062) 0:04:10.163 **** 2021-02-10T23:38:12.105 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-02-10T23:38:12.106 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.140 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.061) 0:04:10.225 **** 2021-02-10T23:38:12.167 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.204 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.063) 0:04:10.288 **** 2021-02-10T23:38:12.230 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-02-10T23:38:12.231 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.267 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.063) 0:04:10.351 **** 2021-02-10T23:38:12.293 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-10T23:38:12.294 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.328 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.061) 0:04:10.413 **** 2021-02-10T23:38:12.366 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-02-10T23:38:12.367 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.407 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.078) 0:04:10.491 **** 2021-02-10T23:38:12.570 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-02-10T23:38:12.572 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:12.703 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:12 +0000 (0:00:00.296) 0:04:10.787 **** 2021-02-10T23:38:12.868 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-02-10T23:38:12.868 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003363", "end": "2021-02-10 23:38:12.843454", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-02-10 23:38:12.840091", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:13.006 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001889", "end": "2021-02-10 23:38:12.978420", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-02-10 23:38:12.976531", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:13.131 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001734", "end": "2021-02-10 23:38:13.107717", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-02-10 23:38:13.105983", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:13.256 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.002064", "end": "2021-02-10 23:38:13.237436", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-02-10 23:38:13.235372", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:13.292 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:13 +0000 (0:00:00.589) 0:04:11.377 **** 2021-02-10T23:38:13.319 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-02-10T23:38:13.354 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:13 +0000 (0:00:00.061) 0:04:11.438 **** 2021-02-10T23:38:13.507 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-02-10T23:38:13.509 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-02-10T23:38:13.626 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-02-10T23:38:13.661 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:13 +0000 (0:00:00.306) 0:04:11.745 **** 2021-02-10T23:38:14.209 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba001.front.sepia.ceph.com] 2021-02-10T23:38:14.286 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:14 +0000 (0:00:00.625) 0:04:12.370 **** 2021-02-10T23:38:14.313 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-10T23:38:14.314 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:14.351 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:14 +0000 (0:00:00.064) 0:04:12.435 **** 2021-02-10T23:38:14.389 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-02-10T23:38:14.390 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-02-10T23:38:14.427 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:14 +0000 (0:00:00.075) 0:04:12.511 **** 2021-02-10T23:38:14.474 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-02-10T23:38:14.476 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-02-10T23:38:14.511 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:14 +0000 (0:00:00.084) 0:04:12.595 **** 2021-02-10T23:38:16.393 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-02-10T23:38:16.602 INFO:teuthology.task.ansible.out:ok: [gibba001.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: podman", "Installed: podman-docker"]} Wednesday 10 February 2021 23:38:16 +0000 (0:00:01.919) 0:04:14.515 **** TASK [container-host : set_fact] *********************************************** ok: [gibba001.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} Wednesday 10 February 2021 23:38:16 +0000 (0:00:00.063) 0:04:14.579 **** TASK [container-host : set_fact] *********************************************** skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Wednesday 10 February 2021 23:38:16 +0000 (0:00:00.066) 0:04:14.645 **** 2021-02-10T23:38:17.826 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [gibba001.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} changed: [gibba001.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} Wednesday 10 February 2021 23:38:16 +0000 (0:00:00.353) 0:04:14.999 **** TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-02-10T23:38:17.828 INFO:teuthology.task.ansible.out: changed: [gibba001.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613000296.9527946-66465214080039/source", "state": "file", "uid": 0} changed: [gibba001.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1613000297.3667128-99963223207434/source", "state": "file", "uid": 0} Wednesday 10 February 2021 23:38:17 +0000 (0:00:00.869) 0:04:15.868 **** 2021-02-10T23:38:20.323 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-02-10T23:38:20.324 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7r0fp0x8-build\nCollecting toml (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl\nCollecting docopt (from registries-conf-ctl==1.0)\n Downloading https://files.pythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz\nInstalling collected packages: toml, docopt, registries-conf-ctl\n Running setup.py install for docopt: started\n Running setup.py install for docopt: finished with status 'done'\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-7r0fp0x8-build", "Collecting toml (from registries-conf-ctl==1.0)", " Downloading https://files.pythonhosted.org/packages/44/6f/7120676b6d73228c96e17f1f794d8ab046fc910d781c8d151120c3f1569e/toml-0.10.2-py2.py3-none-any.whl", "Collecting docopt (from registries-conf-ctl==1.0)", " Downloading https://files.p 2021-02-10T23:38:20.325 INFO:teuthology.task.ansible.out:ythonhosted.org/packages/a2/55/8f8cab2afd404cf578136ef2cc5dfb50baa1761b68c9da1fb1e4eed343c9/docopt-0.6.2.tar.gz", "Installing collected packages: toml, docopt, registries-conf-ctl", " Running setup.py install for docopt: started", " Running setup.py install for docopt: finished with status 'done'", " Running setup.py install for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-02-10T23:38:20.358 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:20 +0000 (0:00:02.574) 0:04:18.443 **** 2021-02-10T23:38:20.386 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-02-10T23:38:20.387 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:20.426 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:20 +0000 (0:00:00.067) 0:04:18.510 **** 2021-02-10T23:38:20.456 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-02-10T23:38:20.457 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:20.513 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:20 +0000 (0:00:00.087) 0:04:18.598 **** 2021-02-10T23:38:20.780 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-02-10T23:38:20.782 INFO:teuthology.task.ansible.out:changed: [gibba001.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.115021", "end": "2021-02-10 23:38:20.763967", "rc": 0, "start": "2021-02-10 23:38:20.648946", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-02-10T23:38:20.817 INFO:teuthology.task.ansible.out:Wednesday 10 February 2021 23:38:20 +0000 (0:00:00.304) 0:04:18.902 **** 2021-02-10T23:38:20.844 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-02-10T23:38:20.845 INFO:teuthology.task.ansible.out:skipping: [gibba001.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-02-10T23:38:20.942 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-02-10T23:38:20.945 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-02-10T23:38:20.949 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-02-10T23:38:20.950 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* gibba001.front.sepia.ceph.com : ok=136 changed=44 unreachable=0 failed=0 skipped=174 rescued=0 ignored=4 Wednesday 10 February 2021 23:38:20 +0000 (0:00:00.132) 0:04:19.034 **** =============================================================================== testnode : Install packages -------------------------------------------- 35.87s common : nrpe - Ensure SELinux policy is up to date -------------------- 27.90s users : Create all admin users with sudo access. ----------------------- 25.07s users : Update authorized_keys using the keys repo --------------------- 25.07s common : Register with subscription-manager. --------------------------- 12.22s common : nrpe - Remove SELinux policy package -------------------------- 10.22s common : nrpe - Load SELinux policy package ---------------------------- 10.21s users : Remove revoked users -------------------------------------------- 9.34s testnode : Zap all non-root disks --------------------------------------- 8.13s testnode : Ensure ceph packages are not present. ------------------------ 4.76s testnode : Ensure ceph dependency packages are not present. ------------- 4.33s container-host : Install registries-conf-ctl ---------------------------- 2.57s common : Enable necessary rhsm repos ------------------------------------ 2.51s common : Install Kerberos Packages (RedHat) ----------------------------- 2.23s common : Get list of enabled RHSM repos --------------------------------- 1.99s testnode : Install epel packages ---------------------------------------- 1.98s common : nrpe - Install SELinux dependencies ---------------------------- 1.97s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 1.97s common : Make sure smartmontools is installed --------------------------- 1.96s testnode : Make sure rpm dependencies are installed --------------------- 1.95s 2021-02-10T23:38:21.294 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba001.front.sepia.ceph.com')] 2021-02-10T23:38:21.295 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-02-10T23:38:21.296 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba001.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-02-10T23:38:21.364 DEBUG:teuthology.orchestra.run.gibba001:> true 2021-02-10T23:38:21.443 INFO:teuthology.run_tasks:Running task clock... 2021-02-10T23:38:21.456 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-02-10T23:38:21.456 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-02-10T23:38:21.457 DEBUG:teuthology.orchestra.run.gibba001:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-10T23:38:21.507 INFO:teuthology.orchestra.run.gibba001.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-02-10T23:38:21.517 INFO:teuthology.orchestra.run.gibba001.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-02-10T23:38:21.551 INFO:teuthology.orchestra.run.gibba001.stderr:sudo: ntpd: command not found 2021-02-10T23:38:21.559 INFO:teuthology.orchestra.run.gibba001.stdout:506 Cannot talk to daemon 2021-02-10T23:38:21.569 INFO:teuthology.orchestra.run.gibba001.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-02-10T23:38:21.579 INFO:teuthology.orchestra.run.gibba001.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-02-10T23:38:21.625 INFO:teuthology.orchestra.run.gibba001.stderr:bash: ntpq: command not found 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:210 Number of sources = 4 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:=============================================================================== 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-10T23:38:21.629 INFO:teuthology.orchestra.run.gibba001.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-02-10T23:38:21.629 INFO:teuthology.run_tasks:Running task install... 2021-02-10T23:38:22.768 DEBUG:teuthology.task.install:project ceph 2021-02-10T23:38:22.769 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '83d3ac1b03b4de4360f18a023c40ea1ae6fc3928'}} 2021-02-10T23:38:22.769 DEBUG:teuthology.task.install:config {'sha1': '83d3ac1b03b4de4360f18a023c40ea1ae6fc3928'} 2021-02-10T23:38:22.769 INFO:teuthology.task.install:Using flavor: basic 2021-02-10T23:38:22.783 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-02-10T23:38:22.783 INFO:teuthology.task.install:extra packages: [] 2021-02-10T23:38:22.783 DEBUG:teuthology.orchestra.run.gibba001:> sudo lsb_release -is 2021-02-10T23:38:22.814 INFO:teuthology.orchestra.run.gibba001.stdout:RedHatEnterprise 2021-02-10T23:38:22.815 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-02-10T23:38:22.815 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '83d3ac1b03b4de4360f18a023c40ea1ae6fc3928', 'tag': None, 'wait_for_package': False} 2021-02-10T23:38:22.815 DEBUG:teuthology.orchestra.run.gibba001:> sudo lsb_release -is 2021-02-10T23:38:22.883 INFO:teuthology.orchestra.run.gibba001.stdout:RedHatEnterprise 2021-02-10T23:38:22.884 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-02-10T23:38:22.885 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 2021-02-10T23:38:23.061 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/master/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/centos/8/flavors/default/ 2021-02-10T23:38:23.062 INFO:teuthology.task.install.rpm:Package version is 17.0.0-645.g83d3ac1b 2021-02-10T23:38:23.356 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/master/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/master/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/master/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-02-10T23:38:23.356 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:38:23.356 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-02-10T23:38:23.377 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2021-02-10T23:38:23.377 DEBUG:teuthology.orchestra.run.gibba001:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-02-10T23:38:23.441 DEBUG:teuthology.orchestra.run.gibba001:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-02-10T23:38:23.508 DEBUG:teuthology.orchestra.run.gibba001:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-02-10T23:38:23.567 INFO:teuthology.orchestra.run.gibba001.stdout:check_obsoletes = 1 2021-02-10T23:38:23.568 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum clean all 2021-02-10T23:38:23.808 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:38:24.059 INFO:teuthology.orchestra.run.gibba001.stdout:120 files removed 2021-02-10T23:38:24.080 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-radosgw 2021-02-10T23:38:24.276 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:38:25.309 INFO:teuthology.orchestra.run.gibba001.stdout:ceph packages for x86_64 102 kB/s | 73 kB 00:00 2021-02-10T23:38:25.888 INFO:teuthology.orchestra.run.gibba001.stdout:ceph noarch packages 27 kB/s | 15 kB 00:00 2021-02-10T23:38:26.470 INFO:teuthology.orchestra.run.gibba001.stdout:ceph source packages 2.5 kB/s | 1.4 kB 00:00 2021-02-10T23:38:26.926 INFO:teuthology.orchestra.run.gibba001.stdout:Extra Packages for Enterprise Linux 20 MB/s | 8.8 MB 00:00 2021-02-10T23:38:28.243 INFO:teuthology.orchestra.run.gibba001.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2021-02-10T23:38:29.129 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 132 MB/s | 25 MB 00:00 2021-02-10T23:38:31.374 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 144 MB/s | 27 MB 00:00 2021-02-10T23:38:36.130 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:38:36.143 INFO:teuthology.orchestra.run.gibba001.stdout:=================================================================================================== 2021-02-10T23:38:36.143 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:38:36.143 INFO:teuthology.orchestra.run.gibba001.stdout:=================================================================================================== 2021-02-10T23:38:36.144 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:38:36.144 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-radosgw x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 13 M 2021-02-10T23:38:36.144 INFO:teuthology.orchestra.run.gibba001.stdout:Upgrading: 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: librados2 x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 3.7 M 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: librbd1 x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 3.3 M 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-base x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 6.0 M 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-common x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 24 M 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-selinux x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 25 k 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: libcephfs2 x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 798 k 2021-02-10T23:38:36.149 INFO:teuthology.orchestra.run.gibba001.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: libradosstriper1 x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 486 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: librgw2 x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 4.0 M 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-ceph-argparse x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 44 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-ceph-common x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 77 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cephfs x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 186 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rados x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 387 k 2021-02-10T23:38:36.150 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rbd x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 368 k 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rgw x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 114 k 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout:=================================================================================================== 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout:Install 22 Packages 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout:Upgrade 2 Packages 2021-02-10T23:38:36.151 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:38:36.152 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 57 M 2021-02-10T23:38:36.152 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:38:38.800 INFO:teuthology.orchestra.run.gibba001.stdout:(1/24): ceph-base-17.0.0-645.g83d3ac1b.el8.x86_ 2.3 MB/s | 6.0 MB 00:02 2021-02-10T23:38:38.850 INFO:teuthology.orchestra.run.gibba001.stdout:(2/24): ceph-selinux-17.0.0-645.g83d3ac1b.el8.x 499 kB/s | 25 kB 00:00 2021-02-10T23:38:39.056 INFO:teuthology.orchestra.run.gibba001.stdout:(3/24): libcephfs2-17.0.0-645.g83d3ac1b.el8.x86 3.8 MB/s | 798 kB 00:00 2021-02-10T23:38:39.176 INFO:teuthology.orchestra.run.gibba001.stdout:(4/24): libradosstriper1-17.0.0-645.g83d3ac1b.e 4.0 MB/s | 486 kB 00:00 2021-02-10T23:38:39.730 INFO:teuthology.orchestra.run.gibba001.stdout:(5/24): librgw2-17.0.0-645.g83d3ac1b.el8.x86_64 7.3 MB/s | 4.0 MB 00:00 2021-02-10T23:38:39.779 INFO:teuthology.orchestra.run.gibba001.stdout:(6/24): python3-ceph-argparse-17.0.0-645.g83d3a 917 kB/s | 44 kB 00:00 2021-02-10T23:38:39.840 INFO:teuthology.orchestra.run.gibba001.stdout:(7/24): python3-ceph-common-17.0.0-645.g83d3ac1 1.2 MB/s | 77 kB 00:00 2021-02-10T23:38:40.033 INFO:teuthology.orchestra.run.gibba001.stdout:(8/24): python3-cephfs-17.0.0-645.g83d3ac1b.el8 962 kB/s | 186 kB 00:00 2021-02-10T23:38:40.251 INFO:teuthology.orchestra.run.gibba001.stdout:(9/24): python3-rados-17.0.0-645.g83d3ac1b.el8. 1.7 MB/s | 387 kB 00:00 2021-02-10T23:38:40.360 INFO:teuthology.orchestra.run.gibba001.stdout:(10/24): python3-rbd-17.0.0-645.g83d3ac1b.el8.x 3.3 MB/s | 368 kB 00:00 2021-02-10T23:38:40.405 INFO:teuthology.orchestra.run.gibba001.stdout:(11/24): python3-rgw-17.0.0-645.g83d3ac1b.el8.x 2.5 MB/s | 114 kB 00:00 2021-02-10T23:38:40.504 INFO:teuthology.orchestra.run.gibba001.stdout:(12/24): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2021-02-10T23:38:40.544 INFO:teuthology.orchestra.run.gibba001.stdout:(13/24): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2021-02-10T23:38:40.566 INFO:teuthology.orchestra.run.gibba001.stdout:(14/24): leveldb-1.22-1.el8.x86_64.rpm 8.0 MB/s | 181 kB 00:00 2021-02-10T23:38:40.587 INFO:teuthology.orchestra.run.gibba001.stdout:(15/24): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2021-02-10T23:38:40.607 INFO:teuthology.orchestra.run.gibba001.stdout:(16/24): libunwind-1.3.1-3.el8.x86_64.rpm 3.6 MB/s | 75 kB 00:00 2021-02-10T23:38:40.638 INFO:teuthology.orchestra.run.gibba001.stdout:(17/24): python3-prettytable-0.7.2-14.el8.noarc 1.4 MB/s | 44 kB 00:00 2021-02-10T23:38:40.658 INFO:teuthology.orchestra.run.gibba001.stdout:(18/24): librdkafka-0.11.4-1.el8.x86_64.rpm 17 MB/s | 353 kB 00:00 2021-02-10T23:38:40.678 INFO:teuthology.orchestra.run.gibba001.stdout:(19/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 13 MB/s | 259 kB 00:00 2021-02-10T23:38:40.697 INFO:teuthology.orchestra.run.gibba001.stdout:(20/24): librabbitmq-0.9.0-2.el8.x86_64.rpm 2.4 MB/s | 47 kB 00:00 2021-02-10T23:38:41.203 INFO:teuthology.orchestra.run.gibba001.stdout:(21/24): ceph-common-17.0.0-645.g83d3ac1b.el8.x 4.7 MB/s | 24 MB 00:05 2021-02-10T23:38:41.236 INFO:teuthology.orchestra.run.gibba001.stdout:(22/24): librados2-17.0.0-645.g83d3ac1b.el8.x86 6.9 MB/s | 3.7 MB 00:00 2021-02-10T23:38:41.583 INFO:teuthology.orchestra.run.gibba001.stdout:(23/24): ceph-radosgw-17.0.0-645.g83d3ac1b.el8. 2.3 MB/s | 13 MB 00:05 2021-02-10T23:38:41.590 INFO:teuthology.orchestra.run.gibba001.stdout:(24/24): librbd1-17.0.0-645.g83d3ac1b.el8.x86_6 8.5 MB/s | 3.3 MB 00:00 2021-02-10T23:38:41.592 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:38:41.592 INFO:teuthology.orchestra.run.gibba001.stdout:Total 11 MB/s | 57 MB 00:05 2021-02-10T23:38:41.594 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:38:41.627 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:38:41.627 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:38:42.009 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:38:42.012 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:38:43.044 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:38:43.300 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2021-02-10T23:38:43.473 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-02-10T23:38:43.837 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/26 2021-02-10T23:38:44.090 INFO:teuthology.orchestra.run.gibba001.stdout: Upgrading : librados2-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/26 2021-02-10T23:38:44.183 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librados2-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/26 2021-02-10T23:38:44.419 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-rados-2:17.0.0-645.g83d3ac1b.el8.x86_64 4/26 2021-02-10T23:38:44.666 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : liboath-2.6.2-3.el8.x86_64 5/26 2021-02-10T23:38:44.898 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libcephfs2-2:17.0.0-645.g83d3ac1b.el8.x86_64 6/26 2021-02-10T23:38:45.180 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: libcephfs2-2:17.0.0-645.g83d3ac1b.el8.x86_64 6/26 2021-02-10T23:38:45.439 INFO:teuthology.orchestra.run.gibba001.stdout: Upgrading : librbd1-2:17.0.0-645.g83d3ac1b.el8.x86_64 7/26 2021-02-10T23:38:45.497 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librbd1-2:17.0.0-645.g83d3ac1b.el8.x86_64 7/26 2021-02-10T23:38:45.741 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 8/26 2021-02-10T23:38:45.965 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-10T23:38:46.301 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/26 2021-02-10T23:38:46.548 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : librgw2-2:17.0.0-645.g83d3ac1b.el8.x86_64 10/26 2021-02-10T23:38:46.602 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librgw2-2:17.0.0-645.g83d3ac1b.el8.x86_64 10/26 2021-02-10T23:38:46.844 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2021-02-10T23:38:46.996 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-ceph-argparse-2:17.0.0-645.g83d3ac1b.el8.x 12/26 2021-02-10T23:38:47.190 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cephfs-2:17.0.0-645.g83d3ac1b.el8.x86_64 13/26 2021-02-10T23:38:47.480 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-rgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 14/26 2021-02-10T23:38:47.707 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-rbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 15/26 2021-02-10T23:38:47.923 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libradosstriper1-2:17.0.0-645.g83d3ac1b.el8.x86_64 16/26 2021-02-10T23:38:48.234 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: libradosstriper1-2:17.0.0-645.g83d3ac1b.el8.x86_64 16/26 2021-02-10T23:38:48.235 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 17/26 2021-02-10T23:38:48.446 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 18/26 2021-02-10T23:38:48.697 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 19/26 2021-02-10T23:38:48.940 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86 20/26 2021-02-10T23:38:52.100 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 21/26 2021-02-10T23:38:52.357 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 21/26 2021-02-10T23:38:52.919 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 21/26 2021-02-10T23:38:53.241 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-base-2:17.0.0-645.g83d3ac1b.el8.x86_64 22/26 2021-02-10T23:38:53.327 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-base-2:17.0.0-645.g83d3ac1b.el8.x86_64 22/26 2021-02-10T23:38:53.481 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-selinux-2:17.0.0-645.g83d3ac1b.el8.x86_64 23/26 2021-02-10T23:39:03.669 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-selinux-2:17.0.0-645.g83d3ac1b.el8.x86_64 23/26 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /sys 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /proc 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /dev 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /run 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /mnt 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /var/tmp 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /home 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /tmp 2021-02-10T23:39:03.670 INFO:teuthology.orchestra.run.gibba001.stdout:skipping the directory /dev 2021-02-10T23:39:03.671 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:04.833 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-radosgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 24/26 2021-02-10T23:39:04.925 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 24/26 2021-02-10T23:39:04.926 INFO:teuthology.orchestra.run.gibba001.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-10T23:39:05.199 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2021-02-10T23:39:05.200 INFO:teuthology.orchestra.run.gibba001.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-10T23:39:05.883 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-base-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 2/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-radosgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-selinux-2:17.0.0-645.g83d3ac1b.el8.x86_64 4/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libcephfs2-2:17.0.0-645.g83d3ac1b.el8.x86_64 5/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libradosstriper1-2:17.0.0-645.g83d3ac1b.el8.x86_64 6/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librgw2-2:17.0.0-645.g83d3ac1b.el8.x86_64 7/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-ceph-argparse-2:17.0.0-645.g83d3ac1b.el8.x 8/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86 9/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cephfs-2:17.0.0-645.g83d3ac1b.el8.x86_64 10/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-rados-2:17.0.0-645.g83d3ac1b.el8.x86_64 11/26 2021-02-10T23:39:05.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-rbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 12/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-rgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 13/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 14/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 15/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : leveldb-1.22-1.el8.x86_64 16/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 17/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 18/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 19/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 20/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 21/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 22/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librados2-2:17.0.0-645.g83d3ac1b.el8.x86_64 23/26 2021-02-10T23:39:05.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2021-02-10T23:39:05.886 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librbd1-2:17.0.0-645.g83d3ac1b.el8.x86_64 25/26 2021-02-10T23:39:06.571 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2021-02-10T23:39:06.571 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:39:08.129 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:08.703 INFO:teuthology.orchestra.run.gibba001.stdout:Upgraded: 2021-02-10T23:39:08.703 INFO:teuthology.orchestra.run.gibba001.stdout: librados2-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.703 INFO:teuthology.orchestra.run.gibba001.stdout: librbd1-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.703 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-base-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-radosgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-selinux-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: fmt-6.2.1-1.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: gperftools-libs-2.7-6.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: leveldb-1.22-1.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: libcephfs2-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.704 INFO:teuthology.orchestra.run.gibba001.stdout: liboath-2.6.2-3.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: librabbitmq-0.9.0-2.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: libradosstriper1-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: librgw2-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: libunwind-1.3.1-3.el8.x86_64 2021-02-10T23:39:08.705 INFO:teuthology.orchestra.run.gibba001.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-ceph-argparse-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-ceph-common-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cephfs-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rados-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:08.706 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:08.708 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-test 2021-02-10T23:39:08.916 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:10.360 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-02-10T23:39:10.361 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 85 kB/s | 2.4 kB 00:00 2021-02-10T23:39:10.528 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:10.528 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================== 2021-02-10T23:39:10.528 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:39:10.528 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================== 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-test x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 52 M 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================== 2021-02-10T23:39:10.529 INFO:teuthology.orchestra.run.gibba001.stdout:Install 6 Packages 2021-02-10T23:39:10.530 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:10.530 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 53 M 2021-02-10T23:39:10.530 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 228 M 2021-02-10T23:39:10.530 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:39:10.559 INFO:teuthology.orchestra.run.gibba001.stdout:(1/6): jq-1.5-12.el8.x86_64.rpm 5.5 MB/s | 161 kB 00:00 2021-02-10T23:39:10.582 INFO:teuthology.orchestra.run.gibba001.stdout:(2/6): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2021-02-10T23:39:10.609 INFO:teuthology.orchestra.run.gibba001.stdout:(3/6): xmlstarlet-1.6.1-11.el8.x86_64.rpm 876 kB/s | 69 kB 00:00 2021-02-10T23:39:10.610 INFO:teuthology.orchestra.run.gibba001.stdout:(4/6): oniguruma-6.8.2-2.el8.x86_64.rpm 6.4 MB/s | 187 kB 00:00 2021-02-10T23:39:10.636 INFO:teuthology.orchestra.run.gibba001.stdout:(5/6): libxslt-1.1.32-5.el8.x86_64.rpm 9.0 MB/s | 250 kB 00:00 2021-02-10T23:39:13.697 INFO:teuthology.orchestra.run.gibba001.stdout:(6/6): ceph-test-17.0.0-645.g83d3ac1b.el8.x86_6 16 MB/s | 52 MB 00:03 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Total 17 MB/s | 53 MB 00:03 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:39:14.391 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:39:14.392 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:39:14.615 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 1/6 2021-02-10T23:39:14.955 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-10T23:39:15.165 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-10T23:39:15.225 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 3/6 2021-02-10T23:39:15.514 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : jq-1.5-12.el8.x86_64 4/6 2021-02-10T23:39:19.454 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 5/6 2021-02-10T23:39:19.727 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-test-2:17.0.0-645.g83d3ac1b.el8.x86_64 6/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-test-2:17.0.0-645.g83d3ac1b.el8.x86_64 6/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-test-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 2/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : jq-1.5-12.el8.x86_64 3/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 4/6 2021-02-10T23:39:19.899 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 5/6 2021-02-10T23:39:20.105 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 6/6 2021-02-10T23:39:20.634 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-test-2:17.0.0-645.g83d3ac1b.el8.x86_64 jq-1.5-12.el8.x86_64 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout: libxslt-1.1.32-5.el8.x86_64 oniguruma-6.8.2-2.el8.x86_64 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout: socat-1.7.3.3-2.el8.x86_64 xmlstarlet-1.6.1-11.el8.x86_64 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:21.704 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:21.786 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph 2021-02-10T23:39:21.985 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:23.105 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-02-10T23:39:23.105 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 91 kB/s | 2.4 kB 00:00 2021-02-10T23:39:23.695 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================== 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================== 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout: ceph x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 6.4 k 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:39:23.782 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mds x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 2.4 M 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 1.5 M 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-modules-core noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 222 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mon x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 5.0 M 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-osd x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 18 M 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-02-10T23:39:23.783 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2021-02-10T23:39:23.784 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout:Installing weak dependencies: 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2021-02-10T23:39:23.785 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================== 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:Install 37 Packages 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 33 M 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 117 M 2021-02-10T23:39:23.786 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:39:23.837 INFO:teuthology.orchestra.run.gibba001.stdout:(1/37): ceph-17.0.0-645.g83d3ac1b.el8.x86_64.rp 48 kB/s | 6.4 kB 00:00 2021-02-10T23:39:24.819 INFO:teuthology.orchestra.run.gibba001.stdout:(2/37): ceph-mon-17.0.0-645.g83d3ac1b.el8.x86_6 5.1 MB/s | 5.0 MB 00:00 2021-02-10T23:39:24.822 INFO:teuthology.orchestra.run.gibba001.stdout:(3/37): ceph-mgr-17.0.0-645.g83d3ac1b.el8.x86_6 1.4 MB/s | 1.5 MB 00:01 2021-02-10T23:39:24.849 INFO:teuthology.orchestra.run.gibba001.stdout:(4/37): ceph-mds-17.0.0-645.g83d3ac1b.el8.x86_6 2.1 MB/s | 2.4 MB 00:01 2021-02-10T23:39:24.915 INFO:teuthology.orchestra.run.gibba001.stdout:(5/37): python3-bcrypt-3.1.6-2.el8.1.x86_64.rpm 661 kB/s | 44 kB 00:00 2021-02-10T23:39:24.979 INFO:teuthology.orchestra.run.gibba001.stdout:(6/37): python3-beautifulsoup4-4.6.3-2.el8.1.no 2.8 MB/s | 185 kB 00:00 2021-02-10T23:39:24.996 INFO:teuthology.orchestra.run.gibba001.stdout:(7/37): python3-cheroot-8.5.2-1.el8.noarch.rpm 9.8 MB/s | 173 kB 00:00 2021-02-10T23:39:25.029 INFO:teuthology.orchestra.run.gibba001.stdout:(8/37): python3-cherrypy-18.4.0-1.el8.noarch.rp 12 MB/s | 384 kB 00:00 2021-02-10T23:39:25.046 INFO:teuthology.orchestra.run.gibba001.stdout:(9/37): python3-cssselect-0.9.2-10.el8.noarch.r 2.4 MB/s | 40 kB 00:00 2021-02-10T23:39:25.063 INFO:teuthology.orchestra.run.gibba001.stdout:(10/37): python3-jaraco-6.2-6.el8.noarch.rpm 668 kB/s | 11 kB 00:00 2021-02-10T23:39:25.079 INFO:teuthology.orchestra.run.gibba001.stdout:(11/37): python3-jaraco-functools-2.0-4.el8.noa 1.0 MB/s | 18 kB 00:00 2021-02-10T23:39:25.096 INFO:teuthology.orchestra.run.gibba001.stdout:(12/37): python3-logutils-0.3.5-11.el8.noarch.r 2.9 MB/s | 49 kB 00:00 2021-02-10T23:39:25.113 INFO:teuthology.orchestra.run.gibba001.stdout:(13/37): python3-more-itertools-7.2.0-3.el8.noa 3.4 MB/s | 59 kB 00:00 2021-02-10T23:39:25.131 INFO:teuthology.orchestra.run.gibba001.stdout:(14/37): python3-pecan-1.3.2-9.el8.noarch.rpm 15 MB/s | 283 kB 00:00 2021-02-10T23:39:25.148 INFO:teuthology.orchestra.run.gibba001.stdout:(15/37): python3-portend-2.6-1.el8.noarch.rpm 941 kB/s | 16 kB 00:00 2021-02-10T23:39:25.164 INFO:teuthology.orchestra.run.gibba001.stdout:(16/37): python3-simplegeneric-0.8.1-17.el8.noa 1.1 MB/s | 19 kB 00:00 2021-02-10T23:39:25.182 INFO:teuthology.orchestra.run.gibba001.stdout:(17/37): python3-singledispatch-3.4.0.3-18.el8. 1.4 MB/s | 24 kB 00:00 2021-02-10T23:39:25.199 INFO:teuthology.orchestra.run.gibba001.stdout:(18/37): python3-tempora-1.14.1-5.el8.noarch.rp 1.7 MB/s | 29 kB 00:00 2021-02-10T23:39:25.215 INFO:teuthology.orchestra.run.gibba001.stdout:(19/37): python3-trustme-0.6.0-4.el8.noarch.rpm 1.6 MB/s | 27 kB 00:00 2021-02-10T23:39:25.233 INFO:teuthology.orchestra.run.gibba001.stdout:(20/37): python3-waitress-1.2.1-2.el8.1.noarch. 13 MB/s | 241 kB 00:00 2021-02-10T23:39:25.251 INFO:teuthology.orchestra.run.gibba001.stdout:(21/37): python3-webob-1.8.5-1.el8.1.noarch.rpm 14 MB/s | 251 kB 00:00 2021-02-10T23:39:25.268 INFO:teuthology.orchestra.run.gibba001.stdout:(22/37): python3-webtest-2.0.33-1.el8.noarch.rp 5.0 MB/s | 85 kB 00:00 2021-02-10T23:39:25.285 INFO:teuthology.orchestra.run.gibba001.stdout:(23/37): python3-zc-lockfile-2.0-2.el8.noarch.r 1.4 MB/s | 23 kB 00:00 2021-02-10T23:39:25.311 INFO:teuthology.orchestra.run.gibba001.stdout:(24/37): python3-webencodings-0.5.1-6.el8.noarc 1.0 MB/s | 27 kB 00:00 2021-02-10T23:39:25.338 INFO:teuthology.orchestra.run.gibba001.stdout:(25/37): python3-lxml-4.2.3-1.el8.x86_64.rpm 57 MB/s | 1.5 MB 00:00 2021-02-10T23:39:25.357 INFO:teuthology.orchestra.run.gibba001.stdout:(26/37): python3-pyOpenSSL-18.0.0-1.el8.noarch. 5.3 MB/s | 103 kB 00:00 2021-02-10T23:39:25.378 INFO:teuthology.orchestra.run.gibba001.stdout:(27/37): python3-werkzeug-0.12.2-4.el8.noarch.r 22 MB/s | 457 kB 00:00 2021-02-10T23:39:25.396 INFO:teuthology.orchestra.run.gibba001.stdout:(28/37): python3-mako-1.0.6-13.el8.noarch.rpm 8.5 MB/s | 157 kB 00:00 2021-02-10T23:39:25.415 INFO:teuthology.orchestra.run.gibba001.stdout:(29/37): python3-html5lib-0.999999999-6.el8.noa 11 MB/s | 214 kB 00:00 2021-02-10T23:39:25.432 INFO:teuthology.orchestra.run.gibba001.stdout:(30/37): python3-pytz-2017.2-9.el8.noarch.rpm 3.0 MB/s | 54 kB 00:00 2021-02-10T23:39:25.450 INFO:teuthology.orchestra.run.gibba001.stdout:(31/37): python3-markupsafe-0.23-19.el8.x86_64. 2.1 MB/s | 39 kB 00:00 2021-02-10T23:39:25.469 INFO:teuthology.orchestra.run.gibba001.stdout:(32/37): python3-cffi-1.11.5-5.el8.x86_64.rpm 13 MB/s | 238 kB 00:00 2021-02-10T23:39:25.487 INFO:teuthology.orchestra.run.gibba001.stdout:(33/37): python3-asn1crypto-0.24.0-3.el8.noarch 9.6 MB/s | 181 kB 00:00 2021-02-10T23:39:25.505 INFO:teuthology.orchestra.run.gibba001.stdout:(34/37): python3-pycparser-2.14-14.el8.noarch.r 5.8 MB/s | 109 kB 00:00 2021-02-10T23:39:25.526 INFO:teuthology.orchestra.run.gibba001.stdout:(35/37): python3-cryptography-2.3-3.el8.x86_64. 25 MB/s | 511 kB 00:00 2021-02-10T23:39:25.798 INFO:teuthology.orchestra.run.gibba001.stdout:(36/37): ceph-osd-17.0.0-645.g83d3ac1b.el8.x86_ 19 MB/s | 18 MB 00:00 2021-02-10T23:39:25.800 INFO:teuthology.orchestra.run.gibba001.stdout:(37/37): ceph-mgr-modules-core-17.0.0-645.g83d3 227 kB/s | 222 kB 00:00 2021-02-10T23:39:25.801 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:39:25.801 INFO:teuthology.orchestra.run.gibba001.stdout:Total 16 MB/s | 33 MB 00:02 2021-02-10T23:39:25.809 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:39:25.838 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:39:25.838 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:39:26.031 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:39:26.034 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:39:27.423 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:39:27.667 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/37 2021-02-10T23:39:27.896 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/37 2021-02-10T23:39:28.141 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 3/37 2021-02-10T23:39:28.564 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 4/37 2021-02-10T23:39:28.898 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 5/37 2021-02-10T23:39:29.259 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 6/37 2021-02-10T23:39:29.547 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 7/37 2021-02-10T23:39:29.737 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 8/37 2021-02-10T23:39:29.949 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 9/37 2021-02-10T23:39:30.215 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 10/37 2021-02-10T23:39:30.452 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 11/37 2021-02-10T23:39:30.671 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 12/37 2021-02-10T23:39:30.865 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 13/37 2021-02-10T23:39:31.118 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 14/37 2021-02-10T23:39:31.371 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 15/37 2021-02-10T23:39:31.646 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 16/37 2021-02-10T23:39:31.862 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 17/37 2021-02-10T23:39:32.051 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 18/37 2021-02-10T23:39:32.204 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 19/37 2021-02-10T23:39:32.409 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 20/37 2021-02-10T23:39:32.561 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 21/37 2021-02-10T23:39:32.794 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 22/37 2021-02-10T23:39:33.056 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 23/37 2021-02-10T23:39:33.260 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 24/37 2021-02-10T23:39:33.526 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-portend-2.6-1.el8.noarch 25/37 2021-02-10T23:39:33.798 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 26/37 2021-02-10T23:39:34.253 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 27/37 2021-02-10T23:39:34.578 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 28/37 2021-02-10T23:39:34.859 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 29/37 2021-02-10T23:39:35.179 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 30/37 2021-02-10T23:39:35.489 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 31/37 2021-02-10T23:39:35.805 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-645.g83d3ac1b.el8.n 32/37 2021-02-10T23:39:36.050 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-2:17.0.0-645.g83d3ac1b.el8.x86_64 33/37 2021-02-10T23:39:37.261 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mgr-2:17.0.0-645.g83d3ac1b.el8.x86_64 33/37 2021-02-10T23:39:37.499 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-osd-2:17.0.0-645.g83d3ac1b.el8.x86_64 34/37 2021-02-10T23:39:37.839 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-osd-2:17.0.0-645.g83d3ac1b.el8.x86_64 34/37 2021-02-10T23:39:38.075 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mon-2:17.0.0-645.g83d3ac1b.el8.x86_64 35/37 2021-02-10T23:39:38.251 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mon-2:17.0.0-645.g83d3ac1b.el8.x86_64 35/37 2021-02-10T23:39:38.440 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mds-2:17.0.0-645.g83d3ac1b.el8.x86_64 36/37 2021-02-10T23:39:38.454 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mds-2:17.0.0-645.g83d3ac1b.el8.x86_64 36/37 2021-02-10T23:39:38.628 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-2:17.0.0-645.g83d3ac1b.el8.x86_64 37/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-2:17.0.0-645.g83d3ac1b.el8.x86_64 37/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mds-2:17.0.0-645.g83d3ac1b.el8.x86_64 2/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mon-2:17.0.0-645.g83d3ac1b.el8.x86_64 4/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-osd-2:17.0.0-645.g83d3ac1b.el8.x86_64 5/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-645.g83d3ac1b.el8.n 6/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 7/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 8/37 2021-02-10T23:39:38.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 9/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 10/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 11/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 12/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 13/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 14/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 15/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 16/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-portend-2.6-1.el8.noarch 17/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 18/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 19/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 20/37 2021-02-10T23:39:38.882 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 21/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 22/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 23/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 24/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 25/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 26/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 27/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 28/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 29/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 30/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 31/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 32/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 33/37 2021-02-10T23:39:38.883 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 34/37 2021-02-10T23:39:38.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 35/37 2021-02-10T23:39:38.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 36/37 2021-02-10T23:39:39.850 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 37/37 2021-02-10T23:39:39.850 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:39:41.382 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:41.382 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:39:41.382 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:41.382 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mds-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-modules-core-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mon-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-osd-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cryptography-2.3-3.el8.x86_64 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-02-10T23:39:41.383 INFO:teuthology.orchestra.run.gibba001.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jaraco-6.2-6.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-lxml-4.2.3-1.el8.x86_64 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-mako-1.0.6-13.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-portend-2.6-1.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pycparser-2.14-14.el8.noarch 2021-02-10T23:39:41.384 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pytz-2017.2-9.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:41.385 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:41.494 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-base 2021-02-10T23:39:41.705 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:42.081 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-02-10T23:39:42.181 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-02-10T23:39:43.022 INFO:teuthology.orchestra.run.gibba001.stdout:Package ceph-base-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:39:43.276 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:43.276 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:39:43.277 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:43.330 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install cephadm 2021-02-10T23:39:43.536 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:44.019 INFO:teuthology.orchestra.run.gibba001.stdout:Last metadata expiration check: 0:00:01 ago on Wed 10 Feb 2021 11:39:42 PM UTC. 2021-02-10T23:39:45.258 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout: cephadm noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 69 k 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:45.259 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 69 k 2021-02-10T23:39:45.260 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 277 k 2021-02-10T23:39:45.260 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:39:45.506 INFO:teuthology.orchestra.run.gibba001.stdout:cephadm-17.0.0-645.g83d3ac1b.el8.noarch.rpm 278 kB/s | 69 kB 00:00 2021-02-10T23:39:45.507 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:39:45.507 INFO:teuthology.orchestra.run.gibba001.stdout:Total 277 kB/s | 69 kB 00:00 2021-02-10T23:39:45.508 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:39:45.513 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:39:45.513 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:39:45.514 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:39:45.517 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:39:45.601 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:39:47.159 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 1/1 2021-02-10T23:39:47.453 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 1/1 2021-02-10T23:39:47.563 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 1/1 2021-02-10T23:39:47.743 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 1/1 2021-02-10T23:39:47.743 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:39:49.362 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:49.362 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:39:49.362 INFO:teuthology.orchestra.run.gibba001.stdout: cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:39:49.362 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:49.362 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:49.436 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-immutable-object-cache 2021-02-10T23:39:49.650 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:50.082 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 97 kB/s | 2.8 kB 00:00 2021-02-10T23:39:50.181 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-02-10T23:39:52.143 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repo Size 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 163 k 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:39:52.144 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:39:52.145 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:39:52.145 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:52.145 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 163 k 2021-02-10T23:39:52.145 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 587 k 2021-02-10T23:39:52.145 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:39:52.630 INFO:teuthology.orchestra.run.gibba001.stdout:ceph-immutable-object-cache-17.0.0-645.g83d3ac1 336 kB/s | 163 kB 00:00 2021-02-10T23:39:52.631 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:39:52.631 INFO:teuthology.orchestra.run.gibba001.stdout:Total 335 kB/s | 163 kB 00:00 2021-02-10T23:39:52.632 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:39:52.640 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:39:52.640 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:39:52.678 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:39:52.681 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:39:52.778 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:39:52.965 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-645.g83d3ac1b.e 1/1 2021-02-10T23:39:53.236 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-645.g83d3ac1b.e 1/1 2021-02-10T23:39:53.423 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-645.g83d3ac1b.e 1/1 2021-02-10T23:39:53.423 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:39:55.062 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:55.062 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:39:55.062 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-immutable-object-cache-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:39:55.063 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:55.063 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:55.159 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-mgr 2021-02-10T23:39:55.373 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:55.785 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-02-10T23:39:55.884 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-02-10T23:39:56.706 INFO:teuthology.orchestra.run.gibba001.stdout:Package ceph-mgr-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:39:56.962 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:56.963 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:39:56.963 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:39:57.012 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-mgr-dashboard 2021-02-10T23:39:57.220 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:39:57.619 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-02-10T23:39:57.718 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-02-10T23:39:58.801 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================================== 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================================== 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-dashboard noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 2.6 M 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-grafana-dashboards noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 24 k 2021-02-10T23:39:58.802 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-prometheus-alerts noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 8.9 k 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================================== 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout:Install 6 Packages 2021-02-10T23:39:58.803 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:39:58.804 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 2.9 M 2021-02-10T23:39:58.804 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 15 M 2021-02-10T23:39:58.804 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:39:59.131 INFO:teuthology.orchestra.run.gibba001.stdout:(1/6): ceph-prometheus-alerts-17.0.0-645.g83d3a 27 kB/s | 8.9 kB 00:00 2021-02-10T23:39:59.182 INFO:teuthology.orchestra.run.gibba001.stdout:(2/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 665 kB/s | 34 kB 00:00 2021-02-10T23:39:59.200 INFO:teuthology.orchestra.run.gibba001.stdout:(3/6): ceph-grafana-dashboards-17.0.0-645.g83d3 61 kB/s | 24 kB 00:00 2021-02-10T23:39:59.229 INFO:teuthology.orchestra.run.gibba001.stdout:(4/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2021-02-10T23:39:59.232 INFO:teuthology.orchestra.run.gibba001.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 3.8 MB/s | 196 kB 00:00 2021-02-10T23:39:59.702 INFO:teuthology.orchestra.run.gibba001.stdout:(6/6): ceph-mgr-dashboard-17.0.0-645.g83d3ac1b. 2.9 MB/s | 2.6 MB 00:00 2021-02-10T23:39:59.704 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:39:59.704 INFO:teuthology.orchestra.run.gibba001.stdout:Total 3.3 MB/s | 2.9 MB 00:00 2021-02-10T23:39:59.705 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:39:59.711 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:39:59.711 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:39:59.772 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:39:59.775 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:00.037 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:00.306 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 1/6 2021-02-10T23:40:00.548 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 2/6 2021-02-10T23:40:00.783 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 3/6 2021-02-10T23:40:00.887 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-645.g83d3ac1b.el8.no 4/6 2021-02-10T23:40:01.718 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-645.g83d3ac1b.el8.n 5/6 2021-02-10T23:40:02.016 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-645.g83d3ac1b.el8.noarch 6/6 2021-02-10T23:40:02.186 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-645.g83d3ac1b.el8.noarch 6/6 2021-02-10T23:40:02.186 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-645.g83d3ac1b.el8.n 1/6 2021-02-10T23:40:02.187 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-645.g83d3ac1b.el8.noarch 2/6 2021-02-10T23:40:02.187 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-645.g83d3ac1b.el8.no 3/6 2021-02-10T23:40:02.187 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 4/6 2021-02-10T23:40:02.187 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 5/6 2021-02-10T23:40:02.376 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 6/6 2021-02-10T23:40:02.377 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:04.072 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:04.072 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:04.072 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-grafana-dashboards-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:04.072 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-dashboard-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-prometheus-alerts-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout: python3-routes-2.4.1-12.el8.noarch 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:04.073 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:04.192 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-mgr-diskprediction-local 2021-02-10T23:40:04.404 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:04.825 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-02-10T23:40:05.985 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:05.986 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================================== 2021-02-10T23:40:05.986 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:40:05.986 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================================== 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 8.6 M 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:05.987 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================================================== 2021-02-10T23:40:05.988 INFO:teuthology.orchestra.run.gibba001.stdout:Install 8 Packages 2021-02-10T23:40:05.988 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:05.988 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 37 M 2021-02-10T23:40:05.988 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 196 M 2021-02-10T23:40:05.988 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:06.029 INFO:teuthology.orchestra.run.gibba001.stdout:(1/8): python3-numpy-f2py-1.14.3-9.el8.x86_64.r 5.3 MB/s | 225 kB 00:00 2021-02-10T23:40:06.067 INFO:teuthology.orchestra.run.gibba001.stdout:(2/8): python3-numpy-1.14.3-9.el8.x86_64.rpm 97 MB/s | 3.7 MB 00:00 2021-02-10T23:40:06.208 INFO:teuthology.orchestra.run.gibba001.stdout:(3/8): python3-scipy-1.0.0-20.module+el8.1.0+33 66 MB/s | 15 MB 00:00 2021-02-10T23:40:06.218 INFO:teuthology.orchestra.run.gibba001.stdout:(4/8): openblas-threads-0.3.3-5.el8.x86_64.rpm 29 MB/s | 4.4 MB 00:00 2021-02-10T23:40:06.245 INFO:teuthology.orchestra.run.gibba001.stdout:(5/8): libquadmath-8.3.1-5.1.el8.x86_64.rpm 7.1 MB/s | 169 kB 00:00 2021-02-10T23:40:06.370 INFO:teuthology.orchestra.run.gibba001.stdout:(6/8): openblas-0.3.3-5.el8.x86_64.rpm 82 MB/s | 4.3 MB 00:00 2021-02-10T23:40:06.370 INFO:teuthology.orchestra.run.gibba001.stdout:(7/8): libgfortran-8.3.1-5.1.el8.x86_64.rpm 23 MB/s | 639 kB 00:00 2021-02-10T23:40:06.692 INFO:teuthology.orchestra.run.gibba001.stdout:(8/8): ceph-mgr-diskprediction-local-17.0.0-645 12 MB/s | 8.6 MB 00:00 2021-02-10T23:40:06.693 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:06.694 INFO:teuthology.orchestra.run.gibba001.stdout:Total 52 MB/s | 37 MB 00:00 2021-02-10T23:40:06.700 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:06.714 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:06.714 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:07.004 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:07.007 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:07.481 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:07.664 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-10T23:40:07.806 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 1/8 2021-02-10T23:40:07.990 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-10T23:40:08.384 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 2/8 2021-02-10T23:40:09.073 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-10T23:40:09.469 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 3/8 2021-02-10T23:40:09.706 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : openblas-0.3.3-5.el8.x86_64 4/8 2021-02-10T23:40:10.234 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 4/8 2021-02-10T23:40:10.595 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 5/8 2021-02-10T23:40:10.848 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-10T23:40:12.346 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 6/8 2021-02-10T23:40:13.498 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 7/8 2021-02-10T23:40:13.706 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-645.g83d3ac1b 8/8 2021-02-10T23:40:13.880 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-645.g83d3ac1b 8/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-645.g83d3ac1b 1/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7. 2/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 3/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 4/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 5/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 6/8 2021-02-10T23:40:13.881 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 7/8 2021-02-10T23:40:14.093 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 8/8 2021-02-10T23:40:14.093 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-diskprediction-local-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: openblas-0.3.3-5.el8.x86_64 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: openblas-threads-0.3.3-5.el8.x86_64 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2021-02-10T23:40:15.606 INFO:teuthology.orchestra.run.gibba001.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2021-02-10T23:40:15.607 INFO:teuthology.orchestra.run.gibba001.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2021-02-10T23:40:15.607 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:15.607 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:15.695 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-mgr-rook 2021-02-10T23:40:15.906 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:16.315 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 94 kB/s | 2.8 kB 00:00 2021-02-10T23:40:16.415 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-02-10T23:40:17.514 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================================= 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================================= 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-rook noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 28 k 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-02-10T23:40:17.515 INFO:teuthology.orchestra.run.gibba001.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rsa noarch 3.4.2-16.el8 epel 73 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:17.516 INFO:teuthology.orchestra.run.gibba001.stdout:======================================================================================================= 2021-02-10T23:40:17.517 INFO:teuthology.orchestra.run.gibba001.stdout:Install 13 Packages 2021-02-10T23:40:17.517 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:17.517 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 1.9 M 2021-02-10T23:40:17.517 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 24 M 2021-02-10T23:40:17.517 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:17.567 INFO:teuthology.orchestra.run.gibba001.stdout:(1/13): python3-certifi-2018.10.15-7.el8.noarch 328 kB/s | 16 kB 00:00 2021-02-10T23:40:17.567 INFO:teuthology.orchestra.run.gibba001.stdout:(2/13): python3-cachetools-3.1.1-4.el8.noarch.r 659 kB/s | 33 kB 00:00 2021-02-10T23:40:17.600 INFO:teuthology.orchestra.run.gibba001.stdout:(3/13): python3-google-auth-1.1.1-10.el8.noarch 2.4 MB/s | 81 kB 00:00 2021-02-10T23:40:17.616 INFO:teuthology.orchestra.run.gibba001.stdout:(4/13): python3-rsa-3.4.2-16.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2021-02-10T23:40:17.633 INFO:teuthology.orchestra.run.gibba001.stdout:(5/13): python3-websocket-client-0.56.0-5.el8.n 3.6 MB/s | 61 kB 00:00 2021-02-10T23:40:17.663 INFO:teuthology.orchestra.run.gibba001.stdout:(6/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 904 kB/s | 27 kB 00:00 2021-02-10T23:40:17.663 INFO:teuthology.orchestra.run.gibba001.stdout:(7/13): ceph-mgr-rook-17.0.0-645.g83d3ac1b.el8. 192 kB/s | 28 kB 00:00 2021-02-10T23:40:17.675 INFO:teuthology.orchestra.run.gibba001.stdout:(8/13): python3-kubernetes-11.0.0-6.el8.noarch. 11 MB/s | 1.2 MB 00:00 2021-02-10T23:40:17.688 INFO:teuthology.orchestra.run.gibba001.stdout:(9/13): python3-jsonpointer-1.10-11.el8.noarch. 801 kB/s | 20 kB 00:00 2021-02-10T23:40:17.707 INFO:teuthology.orchestra.run.gibba001.stdout:(10/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 2.8 MB/s | 126 kB 00:00 2021-02-10T23:40:17.713 INFO:teuthology.orchestra.run.gibba001.stdout:(11/13): python3-requests-oauthlib-1.0.0-1.el8. 1.6 MB/s | 43 kB 00:00 2021-02-10T23:40:17.719 INFO:teuthology.orchestra.run.gibba001.stdout:(12/13): python3-pyasn1-modules-0.3.7-6.el8.noa 2.6 MB/s | 110 kB 00:00 2021-02-10T23:40:17.727 INFO:teuthology.orchestra.run.gibba001.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 7.7 MB/s | 155 kB 00:00 2021-02-10T23:40:17.727 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:17.727 INFO:teuthology.orchestra.run.gibba001.stdout:Total 9.1 MB/s | 1.9 MB 00:00 2021-02-10T23:40:17.731 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:17.742 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:17.742 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:17.790 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:17.793 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:18.255 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:18.530 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-02-10T23:40:18.792 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-rsa-3.4.2-16.el8.noarch 2/13 2021-02-10T23:40:19.113 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 3/13 2021-02-10T23:40:19.382 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 4/13 2021-02-10T23:40:20.170 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 5/13 2021-02-10T23:40:20.345 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 6/13 2021-02-10T23:40:20.596 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 7/13 2021-02-10T23:40:20.812 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 8/13 2021-02-10T23:40:21.034 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-02-10T23:40:21.326 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 10/13 2021-02-10T23:40:22.238 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 11/13 2021-02-10T23:40:22.521 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 12/13 2021-02-10T23:40:22.715 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-rook-2:17.0.0-645.g83d3ac1b.el8.noarch 13/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-645.g83d3ac1b.el8.noarch 13/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-rook-2:17.0.0-645.g83d3ac1b.el8.noarch 1/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 2/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 3/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 4/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 5/13 2021-02-10T23:40:22.884 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-rsa-3.4.2-16.el8.noarch 6/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 7/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 8/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 9/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 10/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 11/13 2021-02-10T23:40:22.885 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 12/13 2021-02-10T23:40:23.141 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 13/13 2021-02-10T23:40:23.142 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-rook-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-02-10T23:40:24.672 INFO:teuthology.orchestra.run.gibba001.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: python3-rsa-3.4.2-16.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:24.673 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:24.742 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-mgr-cephadm 2021-02-10T23:40:24.954 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:25.361 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 98 kB/s | 2.8 kB 00:00 2021-02-10T23:40:25.458 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-02-10T23:40:26.545 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:26.546 INFO:teuthology.orchestra.run.gibba001.stdout:============================================================================================== 2021-02-10T23:40:26.546 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:40:26.546 INFO:teuthology.orchestra.run.gibba001.stdout:============================================================================================== 2021-02-10T23:40:26.546 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-cephadm noarch 2:17.0.0-645.g83d3ac1b.el8 ceph-noarch 79 k 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout:============================================================================================== 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout:Install 6 Packages 2021-02-10T23:40:26.547 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:26.548 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 5.8 M 2021-02-10T23:40:26.548 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 24 M 2021-02-10T23:40:26.548 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:26.608 INFO:teuthology.orchestra.run.gibba001.stdout:(1/6): python3-apipkg-1.5-6.el8.noarch.rpm 351 kB/s | 21 kB 00:00 2021-02-10T23:40:26.647 INFO:teuthology.orchestra.run.gibba001.stdout:(2/6): python3-remoto-1.1.4-4.el8.noarch.rpm 1.2 MB/s | 48 kB 00:00 2021-02-10T23:40:26.669 INFO:teuthology.orchestra.run.gibba001.stdout:(3/6): python3-execnet-1.7.1-1.el8.noarch.rpm 2.9 MB/s | 355 kB 00:00 2021-02-10T23:40:26.678 INFO:teuthology.orchestra.run.gibba001.stdout:(4/6): python3-jinja2-2.10.1-2.el8_0.noarch.rpm 17 MB/s | 538 kB 00:00 2021-02-10T23:40:26.714 INFO:teuthology.orchestra.run.gibba001.stdout:(5/6): python3-babel-2.5.1-5.el8.noarch.rpm 109 MB/s | 4.8 MB 00:00 2021-02-10T23:40:26.735 INFO:teuthology.orchestra.run.gibba001.stdout:(6/6): ceph-mgr-cephadm-17.0.0-645.g83d3ac1b.el 422 kB/s | 79 kB 00:00 2021-02-10T23:40:26.736 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:26.736 INFO:teuthology.orchestra.run.gibba001.stdout:Total 31 MB/s | 5.8 MB 00:00 2021-02-10T23:40:26.738 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:26.744 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:26.744 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:26.800 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:26.803 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:27.626 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:27.979 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 1/6 2021-02-10T23:40:28.262 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 2/6 2021-02-10T23:40:28.566 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 3/6 2021-02-10T23:40:28.894 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 4/6 2021-02-10T23:40:29.198 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 5/6 2021-02-10T23:40:29.415 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 6/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 6/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 1/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 2/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 3/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 4/6 2021-02-10T23:40:29.575 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 5/6 2021-02-10T23:40:29.786 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 6/6 2021-02-10T23:40:29.786 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:31.325 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-mgr-cephadm-2:17.0.0-645.g83d3ac1b.el8.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: python3-apipkg-1.5-6.el8.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: python3-babel-2.5.1-5.el8.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: python3-execnet-1.7.1-1.el8.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: python3-remoto-1.1.4-4.el8.noarch 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:31.326 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:31.426 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install ceph-fuse 2021-02-10T23:40:31.642 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:32.062 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 99 kB/s | 2.8 kB 00:00 2021-02-10T23:40:32.163 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 83 kB/s | 2.4 kB 00:00 2021-02-10T23:40:33.270 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================== 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repository Size 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================== 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-fuse x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 882 k 2021-02-10T23:40:33.271 INFO:teuthology.orchestra.run.gibba001.stdout:Installing dependencies: 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:====================================================================================== 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:Install 3 Packages 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 985 k 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 3.2 M 2021-02-10T23:40:33.272 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:33.304 INFO:teuthology.orchestra.run.gibba001.stdout:(1/3): fuse-2.9.7-12.el8.x86_64.rpm 2.5 MB/s | 83 kB 00:00 2021-02-10T23:40:33.309 INFO:teuthology.orchestra.run.gibba001.stdout:(2/3): fuse-common-3.2.1-12.el8.x86_64.rpm 578 kB/s | 21 kB 00:00 2021-02-10T23:40:34.002 INFO:teuthology.orchestra.run.gibba001.stdout:(3/3): ceph-fuse-17.0.0-645.g83d3ac1b.el8.x86_6 1.2 MB/s | 882 kB 00:00 2021-02-10T23:40:34.003 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:34.004 INFO:teuthology.orchestra.run.gibba001.stdout:Total 1.3 MB/s | 985 kB 00:00 2021-02-10T23:40:34.005 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:34.021 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:34.021 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:34.074 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:34.077 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:34.225 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:34.225 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 1/3 2021-02-10T23:40:34.225 INFO:teuthology.orchestra.run.gibba001.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2021-02-10T23:40:34.225 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:34.690 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-10T23:40:34.903 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : ceph-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/3 2021-02-10T23:40:35.144 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: ceph-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 3/3 2021-02-10T23:40:35.144 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : ceph-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/3 2021-02-10T23:40:35.144 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/3 2021-02-10T23:40:35.357 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 3/3 2021-02-10T23:40:35.357 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:36.965 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:36.965 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:36.965 INFO:teuthology.orchestra.run.gibba001.stdout: ceph-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-02-10T23:40:36.966 INFO:teuthology.orchestra.run.gibba001.stdout: fuse-common-3.2.1-12.el8.x86_64 2021-02-10T23:40:36.966 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:36.966 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:37.053 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install librados-devel 2021-02-10T23:40:37.271 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:37.688 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-02-10T23:40:37.791 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 77 kB/s | 2.4 kB 00:00 2021-02-10T23:40:38.863 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:38.863 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:38.863 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repo Size 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout: librados-devel x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 131 k 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:38.864 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:38.865 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:40:38.865 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:38.865 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 131 k 2021-02-10T23:40:38.865 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 437 k 2021-02-10T23:40:38.865 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:39.358 INFO:teuthology.orchestra.run.gibba001.stdout:librados-devel-17.0.0-645.g83d3ac1b.el8.x86_64. 265 kB/s | 131 kB 00:00 2021-02-10T23:40:39.359 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:39.359 INFO:teuthology.orchestra.run.gibba001.stdout:Total 264 kB/s | 131 kB 00:00 2021-02-10T23:40:39.360 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:39.364 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:39.364 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:39.404 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:39.407 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:39.503 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:39.728 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : librados-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:39.904 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: librados-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:40.080 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : librados-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:40.080 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:41.725 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:41.725 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:41.725 INFO:teuthology.orchestra.run.gibba001.stdout: librados-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:40:41.725 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:41.725 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:41.793 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install libcephfs2 2021-02-10T23:40:42.010 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:42.448 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 60 kB/s | 2.8 kB 00:00 2021-02-10T23:40:42.546 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-02-10T23:40:43.339 INFO:teuthology.orchestra.run.gibba001.stdout:Package libcephfs2-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:43.594 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:43.696 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:43.696 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:43.697 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install libcephfs-devel 2021-02-10T23:40:43.912 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:44.351 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-02-10T23:40:44.451 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-02-10T23:40:45.539 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:45.539 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:45.539 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repo Size 2021-02-10T23:40:45.539 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout: libcephfs-devel x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 24 k 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 24 k 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 89 k 2021-02-10T23:40:45.540 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:40:45.890 INFO:teuthology.orchestra.run.gibba001.stdout:libcephfs-devel-17.0.0-645.g83d3ac1b.el8.x86_64 68 kB/s | 24 kB 00:00 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Total 68 kB/s | 24 kB 00:00 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:40:45.923 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:40:45.940 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:40:46.620 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : libcephfs-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:47.145 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:47.412 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : libcephfs-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:40:47.412 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:40:49.004 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:49.004 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:40:49.004 INFO:teuthology.orchestra.run.gibba001.stdout: libcephfs-devel-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:40:49.005 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:40:49.005 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:49.075 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install librados2 2021-02-10T23:40:49.288 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:49.697 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-02-10T23:40:49.797 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-02-10T23:40:50.605 INFO:teuthology.orchestra.run.gibba001.stdout:Package librados2-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:50.859 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:50.860 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:50.860 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:50.919 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install librbd1 2021-02-10T23:40:51.133 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:51.535 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 102 kB/s | 2.8 kB 00:00 2021-02-10T23:40:51.636 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 88 kB/s | 2.4 kB 00:00 2021-02-10T23:40:52.464 INFO:teuthology.orchestra.run.gibba001.stdout:Package librbd1-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:52.719 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:52.720 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:52.720 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:53.029 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install python3-rados 2021-02-10T23:40:53.240 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:53.632 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-02-10T23:40:53.728 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 87 kB/s | 2.4 kB 00:00 2021-02-10T23:40:54.556 INFO:teuthology.orchestra.run.gibba001.stdout:Package python3-rados-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:54.811 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:54.812 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:54.812 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:54.868 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install python3-rgw 2021-02-10T23:40:55.083 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:55.598 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 101 kB/s | 2.8 kB 00:00 2021-02-10T23:40:55.699 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 78 kB/s | 2.4 kB 00:00 2021-02-10T23:40:56.506 INFO:teuthology.orchestra.run.gibba001.stdout:Package python3-rgw-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:56.760 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:56.761 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:56.761 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:56.819 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install python3-cephfs 2021-02-10T23:40:57.052 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:57.447 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 kB/s | 2.8 kB 00:00 2021-02-10T23:40:57.545 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 90 kB/s | 2.4 kB 00:00 2021-02-10T23:40:58.523 INFO:teuthology.orchestra.run.gibba001.stdout:Package python3-cephfs-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:40:58.776 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:40:58.777 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:40:58.777 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:40:58.834 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install python3-rbd 2021-02-10T23:40:59.048 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:40:59.442 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 kB/s | 2.8 kB 00:00 2021-02-10T23:40:59.542 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 84 kB/s | 2.4 kB 00:00 2021-02-10T23:41:00.355 INFO:teuthology.orchestra.run.gibba001.stdout:Package python3-rbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 is already installed. 2021-02-10T23:41:00.614 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:41:00.615 INFO:teuthology.orchestra.run.gibba001.stdout:Nothing to do. 2021-02-10T23:41:00.615 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:41:00.677 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install rbd-fuse 2021-02-10T23:41:00.891 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:41:01.292 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-02-10T23:41:01.392 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 89 kB/s | 2.4 kB 00:00 2021-02-10T23:41:02.444 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout: Package Architecture Version Repository Size 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-fuse x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 89 k 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:41:02.445 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:02.446 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 89 k 2021-02-10T23:41:02.446 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 298 k 2021-02-10T23:41:02.446 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:41:02.828 INFO:teuthology.orchestra.run.gibba001.stdout:rbd-fuse-17.0.0-645.g83d3ac1b.el8.x86_64.rpm 232 kB/s | 89 kB 00:00 2021-02-10T23:41:02.829 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:41:02.830 INFO:teuthology.orchestra.run.gibba001.stdout:Total 231 kB/s | 89 kB 00:00 2021-02-10T23:41:02.830 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:41:02.838 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:41:02.838 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:41:02.877 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:41:02.880 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:41:02.967 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:41:03.186 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : rbd-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:03.377 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: rbd-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:03.533 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : rbd-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:03.533 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:41:05.106 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:05.106 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:41:05.106 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-fuse-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:41:05.106 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:05.106 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:41:05.176 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install rbd-mirror 2021-02-10T23:41:05.393 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:41:05.770 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 105 kB/s | 2.8 kB 00:00 2021-02-10T23:41:06.964 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout: Package Arch Version Repo Size 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-mirror x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 3.7 M 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:41:06.965 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:06.966 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 3.7 M 2021-02-10T23:41:06.966 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 18 M 2021-02-10T23:41:06.966 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:41:07.873 INFO:teuthology.orchestra.run.gibba001.stdout:rbd-mirror-17.0.0-645.g83d3ac1b.el8.x86_64.rpm 4.1 MB/s | 3.7 MB 00:00 2021-02-10T23:41:07.873 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:41:07.874 INFO:teuthology.orchestra.run.gibba001.stdout:Total 4.1 MB/s | 3.7 MB 00:00 2021-02-10T23:41:07.874 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:41:07.884 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:41:07.884 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:41:07.933 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:41:07.954 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:41:08.315 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:41:08.532 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : rbd-mirror-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:08.782 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: rbd-mirror-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:08.958 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : rbd-mirror-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:08.959 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:41:10.585 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:10.585 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:41:10.585 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-mirror-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:41:10.586 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:10.586 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:41:10.653 DEBUG:teuthology.orchestra.run.gibba001:> sudo yum -y install rbd-nbd 2021-02-10T23:41:10.872 INFO:teuthology.orchestra.run.gibba001.stdout:Updating Subscription Management repositories. 2021-02-10T23:41:11.273 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 100 kB/s | 2.8 kB 00:00 2021-02-10T23:41:11.371 INFO:teuthology.orchestra.run.gibba001.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 90 kB/s | 2.4 kB 00:00 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout:Dependencies resolved. 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout: Package Architecture Version Repository Size 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout:Installing: 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-nbd x86_64 2:17.0.0-645.g83d3ac1b.el8 ceph 174 k 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:12.475 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction Summary 2021-02-10T23:41:12.476 INFO:teuthology.orchestra.run.gibba001.stdout:================================================================================ 2021-02-10T23:41:12.476 INFO:teuthology.orchestra.run.gibba001.stdout:Install 1 Package 2021-02-10T23:41:12.476 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:12.476 INFO:teuthology.orchestra.run.gibba001.stdout:Total download size: 174 k 2021-02-10T23:41:12.477 INFO:teuthology.orchestra.run.gibba001.stdout:Installed size: 649 k 2021-02-10T23:41:12.477 INFO:teuthology.orchestra.run.gibba001.stdout:Downloading Packages: 2021-02-10T23:41:13.038 INFO:teuthology.orchestra.run.gibba001.stdout:rbd-nbd-17.0.0-645.g83d3ac1b.el8.x86_64.rpm 309 kB/s | 174 kB 00:00 2021-02-10T23:41:13.038 INFO:teuthology.orchestra.run.gibba001.stdout:-------------------------------------------------------------------------------- 2021-02-10T23:41:13.039 INFO:teuthology.orchestra.run.gibba001.stdout:Total 308 kB/s | 174 kB 00:00 2021-02-10T23:41:13.039 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction check 2021-02-10T23:41:13.048 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction check succeeded. 2021-02-10T23:41:13.048 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction test 2021-02-10T23:41:13.088 INFO:teuthology.orchestra.run.gibba001.stdout:Transaction test succeeded. 2021-02-10T23:41:13.091 INFO:teuthology.orchestra.run.gibba001.stdout:Running transaction 2021-02-10T23:41:13.191 INFO:teuthology.orchestra.run.gibba001.stdout: Preparing : 1/1 2021-02-10T23:41:13.411 INFO:teuthology.orchestra.run.gibba001.stdout: Installing : rbd-nbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:13.570 INFO:teuthology.orchestra.run.gibba001.stdout: Running scriptlet: rbd-nbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:13.783 INFO:teuthology.orchestra.run.gibba001.stdout: Verifying : rbd-nbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 1/1 2021-02-10T23:41:13.783 INFO:teuthology.orchestra.run.gibba001.stdout:Installed products updated. 2021-02-10T23:41:15.412 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:15.412 INFO:teuthology.orchestra.run.gibba001.stdout:Installed: 2021-02-10T23:41:15.412 INFO:teuthology.orchestra.run.gibba001.stdout: rbd-nbd-2:17.0.0-645.g83d3ac1b.el8.x86_64 2021-02-10T23:41:15.412 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:41:15.412 INFO:teuthology.orchestra.run.gibba001.stdout:Complete! 2021-02-10T23:41:15.518 DEBUG:teuthology.parallel:result is None 2021-02-10T23:41:15.519 DEBUG:teuthology.orchestra.run.gibba001:> sudo lsb_release -is 2021-02-10T23:41:15.549 INFO:teuthology.orchestra.run.gibba001.stdout:RedHatEnterprise 2021-02-10T23:41:15.550 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2021-02-10T23:41:15.551 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 2021-02-10T23:41:15.723 DEBUG:teuthology.orchestra.run.gibba001:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-02-10T23:41:15.739 INFO:teuthology.orchestra.run.gibba001.stdout:17.0.0-645.g83d3ac1b.el8 2021-02-10T23:41:15.740 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-645.g83d3ac1b.el8 2021-02-10T23:41:15.740 INFO:teuthology.task.install:The correct ceph version 17.0.0-645.g83d3ac1b is installed. 2021-02-10T23:41:15.740 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-02-10T23:41:15.748 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:15.748 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-02-10T23:41:15.799 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-02-10T23:41:15.799 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:15.799 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/usr/bin/daemon-helper 2021-02-10T23:41:15.858 DEBUG:teuthology.orchestra.run.gibba001:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-02-10T23:41:15.917 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-02-10T23:41:15.917 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:15.917 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/usr/bin/adjust-ulimits 2021-02-10T23:41:15.976 DEBUG:teuthology.orchestra.run.gibba001:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-02-10T23:41:16.034 INFO:teuthology.run_tasks:Running task cephadm... 2021-02-10T23:41:16.140 INFO:tasks.cephadm:Config: {'fs': 'xfs', 'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'create_rbd_pool': True, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '83d3ac1b03b4de4360f18a023c40ea1ae6fc3928'} 2021-02-10T23:41:16.141 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 2021-02-10T23:41:16.141 INFO:tasks.cephadm:Cluster fsid is 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:41:16.141 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-02-10T23:41:16.141 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.2.101'} 2021-02-10T23:41:16.142 INFO:tasks.cephadm:First mon is mon.a on gibba001 2021-02-10T23:41:16.142 INFO:tasks.cephadm:First mgr is x 2021-02-10T23:41:16.142 INFO:tasks.cephadm:Normalizing hostnames... 2021-02-10T23:41:16.142 DEBUG:teuthology.orchestra.run.gibba001:> sudo hostname $(hostname -s) 2021-02-10T23:41:16.164 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref 83d3ac1b03b4de4360f18a023c40ea1ae6fc3928)... 2021-02-10T23:41:16.165 DEBUG:teuthology.orchestra.run.gibba001:> curl --silent https://raw.githubusercontent.com/ceph/ceph/83d3ac1b03b4de4360f18a023c40ea1ae6fc3928/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2021-02-10T23:41:16.487 INFO:teuthology.orchestra.run.gibba001.stdout:-rw-rw-r--. 1 ubuntu ubuntu 278665 Feb 10 23:41 /home/ubuntu/cephtest/cephadm 2021-02-10T23:41:16.487 DEBUG:teuthology.orchestra.run.gibba001:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-02-10T23:41:16.506 DEBUG:teuthology.orchestra.run.gibba001:> sudo mkdir -p /etc/ceph 2021-02-10T23:41:16.558 DEBUG:teuthology.orchestra.run.gibba001:> sudo chmod 777 /etc/ceph 2021-02-10T23:41:16.617 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-02-10T23:41:16.617 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:16.618 DEBUG:teuthology.orchestra.run.gibba001:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-02-10T23:41:16.670 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:16.672 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/containers/registries.conf 2021-02-10T23:41:16.729 INFO:tasks.cephadm:Writing seed config... 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2021-02-10T23:41:16.731 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2021-02-10T23:41:16.732 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2021-02-10T23:41:16.733 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:41:16.733 DEBUG:teuthology.orchestra.run.gibba001:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-02-10T23:41:16.780 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7788ccb8-6bf9-11eb-8fef-001a4aab830c [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-02-10T23:41:16.780 DEBUG:teuthology.orchestra.run.gibba001:mon.a> sudo journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service 2021-02-10T23:41:16.823 DEBUG:teuthology.orchestra.run.gibba001:mgr.x> sudo journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x.service 2021-02-10T23:41:16.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:-- Logs begin at Wed 2021-02-10 23:32:46 UTC. -- 2021-02-10T23:41:16.841 INFO:tasks.cephadm:Bootstrapping... 2021-02-10T23:41:16.841 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -v bootstrap --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.2.101 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-02-10T23:41:16.857 INFO:journalctl@ceph.mgr.x.gibba001.stdout:-- Logs begin at Wed 2021-02-10 23:32:46 UTC. -- 2021-02-10T23:41:17.148 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman --version 2021-02-10T23:41:17.702 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: podman version 2.0.5 2021-02-10T23:41:17.703 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying podman|docker is present... 2021-02-10T23:41:17.703 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman --version 2021-02-10T23:41:17.731 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: podman version 2.0.5 2021-02-10T23:41:17.732 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying lvm2 is present... 2021-02-10T23:41:17.733 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying time synchronization is in place... 2021-02-10T23:41:17.733 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled chrony.service 2021-02-10T23:41:17.737 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-02-10T23:41:17.738 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active chrony.service 2021-02-10T23:41:17.741 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:41:17.742 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled chronyd.service 2021-02-10T23:41:17.746 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: enabled 2021-02-10T23:41:17.746 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active chronyd.service 2021-02-10T23:41:17.749 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: active 2021-02-10T23:41:17.750 INFO:teuthology.orchestra.run.gibba001.stderr:Unit chronyd.service is enabled and running 2021-02-10T23:41:17.750 INFO:teuthology.orchestra.run.gibba001.stderr:Repeating the final host check... 2021-02-10T23:41:17.750 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman --version 2021-02-10T23:41:17.772 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: podman version 2.0.5 2021-02-10T23:41:17.773 INFO:teuthology.orchestra.run.gibba001.stderr:podman|docker (/bin/podman) is present 2021-02-10T23:41:17.773 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl is present 2021-02-10T23:41:17.773 INFO:teuthology.orchestra.run.gibba001.stderr:lvcreate is present 2021-02-10T23:41:17.773 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled chrony.service 2021-02-10T23:41:17.777 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-02-10T23:41:17.777 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active chrony.service 2021-02-10T23:41:17.781 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:41:17.781 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled chronyd.service 2021-02-10T23:41:17.785 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: enabled 2021-02-10T23:41:17.786 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active chronyd.service 2021-02-10T23:41:17.789 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: active 2021-02-10T23:41:17.790 INFO:teuthology.orchestra.run.gibba001.stderr:Unit chronyd.service is enabled and running 2021-02-10T23:41:17.790 INFO:teuthology.orchestra.run.gibba001.stderr:Host looks OK 2021-02-10T23:41:17.790 INFO:teuthology.orchestra.run.gibba001.stderr:Cluster fsid: 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:41:17.790 INFO:teuthology.orchestra.run.gibba001.stderr:Acquiring lock 140543330888112 on /run/cephadm/7788ccb8-6bf9-11eb-8fef-001a4aab830c.lock 2021-02-10T23:41:17.790 INFO:teuthology.orchestra.run.gibba001.stderr:Lock 140543330888112 acquired on /run/cephadm/7788ccb8-6bf9-11eb-8fef-001a4aab830c.lock 2021-02-10T23:41:17.791 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying IP 172.21.2.101 port 3300 ... 2021-02-10T23:41:17.791 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying IP 172.21.2.101 port 6789 ... 2021-02-10T23:41:17.791 INFO:teuthology.orchestra.run.gibba001.stderr:Base mon IP is 172.21.2.101, final addrv is [v2:172.21.2.101:3300,v1:172.21.2.101:6789] 2021-02-10T23:41:17.791 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /sbin/ip route ls 2021-02-10T23:41:17.792 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: default via 172.21.15.254 dev enp1s0f0 proto dhcp metric 100 2021-02-10T23:41:17.792 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: 172.21.0.0/20 dev enp1s0f0 proto kernel scope link src 172.21.2.101 metric 100 2021-02-10T23:41:17.792 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /sbin/ip -6 route ls 2021-02-10T23:41:17.794 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-02-10T23:41:17.794 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: fe80::/64 dev enp1s0f0 proto kernel metric 256 pref medium 2021-02-10T23:41:17.794 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp1s0f0 proto ra metric 1024 expires 1797sec hoplimit 64 pref medium 2021-02-10T23:41:17.794 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /sbin/ip -6 addr ls 2021-02-10T23:41:17.795 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-02-10T23:41:17.795 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: inet6 ::1/128 scope host 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: 4: enp1s0f0: mtu 1500 state UP qlen 1000 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: inet6 fe80::3eec:efff:fe3d:8fb8/64 scope link 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:Mon IP 172.21.2.101 is in CIDR network 172.21.0.0/20 2021-02-10T23:41:17.796 INFO:teuthology.orchestra.run.gibba001.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2021-02-10T23:41:17.797 INFO:teuthology.orchestra.run.gibba001.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928... 2021-02-10T23:41:17.797 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman pull quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 2021-02-10T23:41:19.039 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928... 2021-02-10T23:41:19.124 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Getting image source signatures 2021-02-10T23:41:19.238 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.297 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.313 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.338 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.355 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.380 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:889524391d554cc9bd269d2e47820d562c512d9d60fd7d4da881803a833083d7 2021-02-10T23:41:19.430 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.513 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.513 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.514 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.515 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:a3ed95caeb02ffe68cdd9fd84406680ae93d633cb16422d00e8a7c22955b46d4 2021-02-10T23:41:19.621 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Copying blob sha256:ea06fd75bb5b7a2cf021f1870e2250fee202e4926f3ee31f5fdf9bd07b6c2c6e 2021-02-10T23:41:55.256 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Writing manifest to image destination 2021-02-10T23:41:55.257 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: Storing signatures 2021-02-10T23:42:02.391 INFO:teuthology.orchestra.run.gibba001.stderr:/bin/podman: fdddce3db409c101aa85446150a4d64dd21ae512d89c2172183c59e9bfff0aa6 2021-02-10T23:42:02.404 INFO:teuthology.orchestra.run.gibba001.stderr:Extracting ceph user uid/gid from container image... 2021-02-10T23:42:02.404 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint stat --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -c %u %g /var/lib/ceph 2021-02-10T23:42:03.147 INFO:teuthology.orchestra.run.gibba001.stderr:stat: 167 167 2021-02-10T23:42:11.145 INFO:teuthology.orchestra.run.gibba001.stderr:Creating initial keys... 2021-02-10T23:42:11.145 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 --gen-print-key 2021-02-10T23:42:11.605 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-authtool: AQBTbyRgTBuPIxAADxIf1wNlJaVzsWxVcVkdDg== 2021-02-10T23:42:12.092 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 --gen-print-key 2021-02-10T23:42:12.547 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-authtool: AQBUbyRgENwYIBAAv/FMIhPi7PNGX2/JvPHEhg== 2021-02-10T23:42:13.116 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 --gen-print-key 2021-02-10T23:42:13.572 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-authtool: AQBVbyRgNQKMIRAA38uF8P3xGiPPKVBM2p8e3A== 2021-02-10T23:42:14.079 INFO:teuthology.orchestra.run.gibba001.stderr:Creating initial monmap... 2021-02-10T23:42:14.079 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /tmp/ceph-tmpo6s6bxdf:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 --create --clobber --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c --addv a [v2:172.21.2.101:3300,v1:172.21.2.101:6789] /tmp/monmap 2021-02-10T23:42:14.609 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-02-10T23:42:14.610 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:14.610 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr:monmaptool for a [v2:172.21.2.101:3300,v1:172.21.2.101:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/monmaptool: set fsid to 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr:Creating mon... 2021-02-10T23:42:15.138 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmp6bugp8q8:/tmp/keyring:z -v /tmp/ceph-tmpo6s6bxdf:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 --mkfs -i a --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-02-10T23:42:15.634 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.600+0000 7f1ada54f700 0 set uid:gid to 167:167 (ceph:ceph) 2021-02-10T23:42:15.634 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 1 imported monmap: 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: epoch 0 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: last_changed 2021-02-10T23:42:14.566594+0000 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: created 2021-02-10T23:42:14.566594+0000 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0] mon.a 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 0 /usr/bin/ceph-mon: set fsid to 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: RocksDB version: 6.8.1 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.635 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Compile date Feb 8 2021 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: DB SUMMARY 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.error_if_exists: 0 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.create_if_missing: 1 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.paranoid_checks: 1 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.env: 0x558f656fb1c0 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.fs: Posix File System 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.info_log: 0x558f673a29e0 2021-02-10T23:42:15.636 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_file_opening_threads: 16 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.statistics: (nil) 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.use_fsync: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_log_file_size: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.keep_log_file_num: 1000 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.recycle_log_file_num: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.allow_fallocate: 1 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.allow_mmap_reads: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.allow_mmap_writes: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.use_direct_reads: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-02-10T23:42:15.637 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.create_missing_column_families: 0 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.db_log_dir: 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_subcompactions: 1 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_background_flushes: -1 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.advise_random_on_open: 1 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.db_write_buffer_size: 0 2021-02-10T23:42:15.638 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.write_buffer_manager: 0x558f673691d0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.rate_limiter: (nil) 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.wal_recovery_mode: 2 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.enable_thread_tracking: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.enable_pipelined_write: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.unordered_write: 0 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-02-10T23:42:15.639 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.row_cache: None 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.wal_filter: None 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.allow_ingest_behind: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.preserve_deletes: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.two_write_queues: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.manual_wal_flush: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.atomic_flush: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-02-10T23:42:15.640 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.log_readahead_size: 0 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_background_jobs: 2 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_background_compactions: -1 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_total_wal_size: 0 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.max_open_files: -1 2021-02-10T23:42:15.641 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.bytes_per_sync: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Options.compaction_readahead_size: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Compression algorithms supported: 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kZSTD supported: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kXpressCompression supported: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kLZ4HCCompression supported: 1 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kLZ4Compression supported: 1 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kBZip2Compression supported: 0 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kZlibCompression supported: 1 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: kSnappyCompression supported: 1 2021-02-10T23:42:15.642 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.601+0000 7f1ada54f700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.merge_operator: 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_filter: None 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_filter_factory: None 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-02-10T23:42:15.643 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x558f672b41f0) 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: index_type: 0 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: checksum: 1 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_cache: 0x558f672ee110 2021-02-10T23:42:15.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-02-10T23:42:15.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: format_version: 2 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: block_align: 0 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.write_buffer_size: 33554432 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_write_buffer_number: 2 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression: NoCompression 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression: Disabled 2021-02-10T23:42:15.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.prefix_extractor: nullptr 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.num_levels: 7 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.level: 32767 2021-02-10T23:42:15.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.strategy: 0 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compression_opts.enabled: false 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.target_file_size_base: 67108864 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-02-10T23:42:15.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.arena_block_size: 4194304 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.disable_auto_compactions: 0 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-02-10T23:42:15.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.table_properties_collectors: 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.inplace_update_support: 0 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-02-10T23:42:15.650 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.bloom_locality: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.max_successive_merges: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.paranoid_file_checks: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.force_consistency_checks: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.report_bg_io_stats: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.ttl: 2592000 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.602+0000 7f1ada54f700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.603+0000 7f1ada54f700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.603+0000 7f1ada54f700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-02-10T23:42:15.651 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.603+0000 7f1ada54f700 4 rocksdb: DB pointer 0x558f673b5800 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.603+0000 7f1ac33ed700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.603+0000 7f1ac33ed700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-02-10T23:42:15.652 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-02-10T23:42:15.653 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.654 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.655 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-02-10T23:42:15.656 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: 2021-02-10T23:42:15.656 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.605+0000 7f1ada54f700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-02-10T23:42:15.656 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.605+0000 7f1ada54f700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-02-10T23:42:15.656 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph-mon: "debug "2021-02-10T23:42:15.605+0000 7f1ada54f700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-02-10T23:42:16.225 INFO:teuthology.orchestra.run.gibba001.stderr:create mon.a on 2021-02-10T23:42:16.225 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:16.229 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl disable ceph.target 2021-02-10T23:42:16.234 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-02-10T23:42:16.290 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl enable ceph.target 2021-02-10T23:42:16.294 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2021-02-10T23:42:16.350 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl start ceph.target 2021-02-10T23:42:16.354 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl enable ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target 2021-02-10T23:42:16.358 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target → /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target. 2021-02-10T23:42:16.359 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target → /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target. 2021-02-10T23:42:16.413 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl start ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target 2021-02-10T23:42:16.418 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl daemon-reload 2021-02-10T23:42:16.475 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-10T23:42:16.487 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl reset-failed ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-10T23:42:16.491 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Failed to reset failed state of unit ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service: Unit ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service not loaded. 2021-02-10T23:42:16.492 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl enable ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-10T23:42:16.495 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target.wants/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service → /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@.service. 2021-02-10T23:42:16.547 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl start ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-10T23:42:16.838 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:16 gibba001 systemd[1]: Starting Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-10T23:42:16.955 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled firewalld.service 2021-02-10T23:42:16.961 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: disabled 2021-02-10T23:42:16.962 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active firewalld.service 2021-02-10T23:42:16.966 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:42:16.966 INFO:teuthology.orchestra.run.gibba001.stderr:firewalld.service is not enabled 2021-02-10T23:42:16.966 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to enable service . firewalld.service is not available 2021-02-10T23:42:16.966 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-02-10T23:42:16.967 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mon to start... 2021-02-10T23:42:16.967 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mon... 2021-02-10T23:42:16.967 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 status 2021-02-10T23:42:17.162 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:16 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.946006+0000 mon.a (mon.0) 0 : [INF] mkfs 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:17.163 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:16 gibba001 bash[28377]: add4d943dac29098baf753c5e62af043548c11e23d36722f36beb9a56d54342d 2021-02-10T23:42:17.163 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:16 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.943448+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-02-10T23:42:17.163 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:16 gibba001 systemd[1]: Started Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c. 2021-02-10T23:42:17.567 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: cluster: 2021-02-10T23:42:17.567 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: id: 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:17.567 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-02-10T23:42:17.567 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:17.567 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: services: 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 0.622266s) 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mgr: no daemons active 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: data: 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: pgs: 2021-02-10T23:42:17.568 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:18.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.945624+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-02-10T23:42:18.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.945745+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0]} 2021-02-10T23:42:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.946884+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-02-10T23:42:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.948356+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-02-10T23:42:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: cluster 2021-02-10T23:42:16.948659+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-02-10T23:42:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:17 gibba001 conmon[28501]: audit 2021-02-10T23:42:17.567873+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.101:0/283895081' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-02-10T23:42:18.241 INFO:teuthology.orchestra.run.gibba001.stderr:mon is available 2021-02-10T23:42:18.241 INFO:teuthology.orchestra.run.gibba001.stderr:Assimilating anything we can from ceph.conf... 2021-02-10T23:42:18.241 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-02-10T23:42:18.833 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:18.833 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: [global] 2021-02-10T23:42:18.833 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: fsid = 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:18.833 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_host = [v2:172.21.2.101:3300,v1:172.21.2.101:6789] 2021-02-10T23:42:18.833 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: [mgr] 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: [osd] 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-02-10T23:42:18.834 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-02-10T23:42:19.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:18 gibba001 conmon[28501]: audit 2021-02-10T23:42:18.831696+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.2.101:0/4026639058' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-02-10T23:42:19.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:18 gibba001 conmon[28501]: 2021-02-10T23:42:19.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:18 gibba001 conmon[28501]: audit 2021-02-10T23:42:18.833768+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.2.101:0/4026639058' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-02-10T23:42:19.411 INFO:teuthology.orchestra.run.gibba001.stderr:Generating new minimal ceph.conf... 2021-02-10T23:42:19.411 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z -v /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-02-10T23:42:20.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 conmon[28501]: audit 2021-02-10T23:42:19.972428+0000 mon.a (mon.0) 10 : audit 2021-02-10T23:42:20.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 conmon[28501]: [DBG] from='client.? 172.21.2.101:0/2069343591' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:42:20.520 INFO:teuthology.orchestra.run.gibba001.stderr:Restarting the monitor... 2021-02-10T23:42:20.520 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl restart ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-10T23:42:20.798 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 systemd[1]: Stopping Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-10T23:42:20.953 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 conmon[28501]: debug 2021-02-10T23:42:20.568+0000 7f86b758c700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-02-10T23:42:20.954 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 conmon[28501]: debug 2021-02-10T23:42:20.568+0000 7f86b758c700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-02-10T23:42:21.197 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:20 gibba001 podman[29014]: add4d943dac29098baf753c5e62af043548c11e23d36722f36beb9a56d54342d 2021-02-10T23:42:21.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 systemd[1]: ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service: Succeeded. 2021-02-10T23:42:21.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 systemd[1]: Stopped Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c. 2021-02-10T23:42:21.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 systemd[1]: Starting Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-10T23:42:21.636 INFO:teuthology.orchestra.run.gibba001.stderr:Setting mon public_network to 172.21.0.0/20 2021-02-10T23:42:21.637 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config set mon public_network 172.21.0.0/20 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.608+0000 7fc996df5700 0 set uid:gid to 167:167 (ceph:ceph) 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.608+0000 7fc996df5700 0 ceph version 17.0.0-645-g83d3ac1b (83d3ac1b03b4de4360f18a023c40ea1ae6fc3928) quincy (dev), process ceph-mon, pid 7 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.608+0000 7fc996df5700 0 pidfile_write: ignore empty --pid-file 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 0 load: jerasure load: lrc load: isa 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: RocksDB version: 6.8.1 2021-02-10T23:42:21.829 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Compile date Feb 8 2021 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: DB SUMMARY 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: CURRENT file: CURRENT 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: IDENTITY file: IDENTITY 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 72876 ; 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.error_if_exists: 0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.create_if_missing: 0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.paranoid_checks: 1 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.env: 0x55b6327741c0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.fs: Posix File System 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.info_log: 0x55b63302ddc0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_file_opening_threads: 16 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.statistics: (nil) 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.use_fsync: 0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_log_file_size: 0 2021-02-10T23:42:21.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.keep_log_file_num: 1000 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.recycle_log_file_num: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.allow_fallocate: 1 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.allow_mmap_reads: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.allow_mmap_writes: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.use_direct_reads: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.create_missing_column_families: 0 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.db_log_dir: 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_subcompactions: 1 2021-02-10T23:42:21.832 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_background_flushes: -1 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.advise_random_on_open: 1 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.db_write_buffer_size: 0 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.write_buffer_manager: 0x55b633089c50 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.rate_limiter: (nil) 2021-02-10T23:42:21.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.wal_recovery_mode: 2 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.enable_thread_tracking: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.enable_pipelined_write: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.unordered_write: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.row_cache: None 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.wal_filter: None 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.allow_ingest_behind: 0 2021-02-10T23:42:21.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.preserve_deletes: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.two_write_queues: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.manual_wal_flush: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.atomic_flush: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.log_readahead_size: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_background_jobs: 2 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_background_compactions: -1 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-02-10T23:42:21.835 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_total_wal_size: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.max_open_files: -1 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.bytes_per_sync: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Options.compaction_readahead_size: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Compression algorithms supported: 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kZSTD supported: 0 2021-02-10T23:42:21.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kXpressCompression supported: 0 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kLZ4HCCompression supported: 1 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kLZ4Compression supported: 1 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kBZip2Compression supported: 0 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kZlibCompression supported: 1 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: kSnappyCompression supported: 1 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.611+0000 7fc996df5700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.merge_operator: 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_filter: None 2021-02-10T23:42:21.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_filter_factory: None 2021-02-10T23:42:21.838 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-02-10T23:42:21.838 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b632fd41f8) 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cache_index_and_filter_blocks: 1 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cache_index_and_filter_blocks_with_high_priority: 0 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: pin_top_level_index_and_filter: 1 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: index_type: 0 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: data_block_index_type: 0 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: index_shortening: 1 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: data_block_hash_table_util_ratio: 0.750000 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: hash_index_allow_collision: 1 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: checksum: 1 2021-02-10T23:42:21.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: no_block_cache: 0 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_cache: 0x55b63300e510 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_cache_name: BinnedLRUCache 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_cache_options: 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: capacity : 536870912 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: num_shard_bits : 4 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: strict_capacity_limit : 0 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: high_pri_pool_ratio: 0.000 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_cache_compressed: (nil) 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: persistent_cache: (nil) 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_size: 4096 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_size_deviation: 10 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_restart_interval: 16 2021-02-10T23:42:21.840 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: index_block_restart_interval: 1 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: metadata_block_size: 4096 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: partition_filters: 0 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: use_delta_encoding: 1 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: filter_policy: rocksdb.BuiltinBloomFilter 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: whole_key_filtering: 1 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: verify_compression: 0 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: read_amp_bytes_per_bit: 0 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: format_version: 2 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: enable_index_compression: 1 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: block_align: 0 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.write_buffer_size: 33554432 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_write_buffer_number: 2 2021-02-10T23:42:21.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression: NoCompression 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression: Disabled 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.prefix_extractor: nullptr 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.num_levels: 7 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-02-10T23:42:21.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.level: 32767 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.strategy: 0 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compression_opts.enabled: false 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.target_file_size_base: 67108864 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-02-10T23:42:21.843 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.arena_block_size: 4194304 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-02-10T23:42:21.844 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.disable_auto_compactions: 0 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.table_properties_collectors: 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.inplace_update_support: 0 2021-02-10T23:42:21.845 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.bloom_locality: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.max_successive_merges: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.paranoid_file_checks: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.force_consistency_checks: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.report_bg_io_stats: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.ttl: 2592000 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-02-10T23:42:21.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1613000541613637, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.612+0000 7fc996df5700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.613+0000 7fc996df5700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1613000541614376, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 69352, "table_properties": {"data_size": 67645, "index_size": 312, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 9802, "raw_average_key_size": 47, "raw_value_size": 62132, "raw_average_value_size": 300, "num_data_blocks": 10, "num_entries": 207, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1613000541, "oldest_key_time": 3, "file_creation_time": 0}} 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.613+0000 7fc996df5700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.613+0000 7fc996df5700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1613000541614891, "job": 1, "event": "recovery_finished"} 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.614+0000 7fc996df5700 4 rocksdb: DB pointer 0x55b6330d5800 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.614+0000 7fc97dc12700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.614+0000 7fc97dc12700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-02-10T23:42:21.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** DB Stats ** 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** Compaction Stats [default] ** 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: L0 2/0 69.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Sum 2/0 69.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.848 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** Compaction Stats [default] ** 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Flush(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(Total Files): cumulative 0, interval 0 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(L0 Files): cumulative 0, interval 0 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(Keys): cumulative 0, interval 0 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Cumulative compaction: 0.00 GB write, 27.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Interval compaction: 0.00 GB write, 27.82 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:21.849 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** File Read Latency Histogram By Level [default] ** 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** Compaction Stats [default] ** 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: L0 2/0 69.38 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Sum 2/0 69.38 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** Compaction Stats [default] ** 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-02-10T23:42:21.850 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 116.0 0.00 0.00 1 0.001 0 0 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Uptime(secs): 0.0 total, 0.0 interval 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Flush(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(GB): cumulative 0.000, interval 0.000 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(Total Files): cumulative 0, interval 0 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(L0 Files): cumulative 0, interval 0 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: AddFile(Keys): cumulative 0, interval 0 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Cumulative compaction: 0.00 GB write, 27.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: ** File Read Latency Histogram By Level [default] ** 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.851 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.614+0000 7fc996df5700 0 starting mon.a rank 0 at public addrs [v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0] at bind addrs [v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 1 mon.a@-1(???) e1 preinit fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).mds e1 new map 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).mds e1 print_map 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: e1 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: enable_multiple, ever_enabled_multiple: 1,1 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: legacy client fscid: -1 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: No filesystems configured 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: audit 2021-02-10T23:42:19.972428+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.2.101:0/2069343591' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-02-10T23:42:21.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: debug 2021-02-10T23:42:21.615+0000 7fc996df5700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 bash[29121]: 574b0d4224dd54e61626af90bfb69fc64459652f521555de90314f64d0db04c3 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 systemd[1]: Started Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c. 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cluster 2021-02-10T23:42:21.619458+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cluster 2021-02-10T23:42:21.619488+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0]} 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cluster 2021-02-10T23:42:21.619509+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cluster 2021-02-10T23:42:21.619525+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-02-10T23:42:21.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:21 gibba001 conmon[29242]: cluster 2021-02-10T23:42:21.619809+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-02-10T23:42:22.804 INFO:teuthology.orchestra.run.gibba001.stderr:Wrote config to /etc/ceph/ceph.conf 2021-02-10T23:42:22.804 INFO:teuthology.orchestra.run.gibba001.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-02-10T23:42:22.804 INFO:teuthology.orchestra.run.gibba001.stderr:Creating mgr... 2021-02-10T23:42:22.804 INFO:teuthology.orchestra.run.gibba001.stderr:Verifying port 9283 ... 2021-02-10T23:42:22.805 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl daemon-reload 2021-02-10T23:42:22.869 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x 2021-02-10T23:42:22.882 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl reset-failed ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x 2021-02-10T23:42:22.886 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Failed to reset failed state of unit ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x.service: Unit ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x.service not loaded. 2021-02-10T23:42:22.886 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl enable ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x 2021-02-10T23:42:22.890 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: Created symlink /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c.target.wants/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x.service → /etc/systemd/system/ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@.service. 2021-02-10T23:42:22.947 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl start ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x 2021-02-10T23:42:23.209 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:22 gibba001 systemd[1]: Starting Ceph mgr.x for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-10T23:42:23.522 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:23 gibba001 conmon[29242]: audit 2021-02-10T23:42:22.250233+0000 mon.a (mon 2021-02-10T23:42:23.522 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:23 gibba001 conmon[29242]: .0) 6 : audit [INF] from='client.? 172.21.2.101:0/3636200640' entity='client.admin' 2021-02-10T23:42:23.529 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled firewalld.service 2021-02-10T23:42:23.535 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: disabled 2021-02-10T23:42:23.535 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active firewalld.service 2021-02-10T23:42:23.540 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:42:23.540 INFO:teuthology.orchestra.run.gibba001.stderr:firewalld.service is not enabled 2021-02-10T23:42:23.540 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to enable service . firewalld.service is not available 2021-02-10T23:42:23.541 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-02-10T23:42:23.541 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled firewalld.service 2021-02-10T23:42:23.545 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: disabled 2021-02-10T23:42:23.546 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active firewalld.service 2021-02-10T23:42:23.550 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:42:23.551 INFO:teuthology.orchestra.run.gibba001.stderr:firewalld.service is not enabled 2021-02-10T23:42:23.551 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-02-10T23:42:23.551 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mgr to start... 2021-02-10T23:42:23.551 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mgr... 2021-02-10T23:42:23.552 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 status -f json-pretty 2021-02-10T23:42:23.788 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:23 gibba001 bash[29512]: d6b007ab412c0db4b6d97e1c43c06223d7e9a2ec8276aa44b151c256a26fd612 2021-02-10T23:42:23.788 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:23 gibba001 systemd[1]: Started Ceph mgr.x for 7788ccb8-6bf9-11eb-8fef-001a4aab830c. 2021-02-10T23:42:24.170 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsid": "7788ccb8-6bf9-11eb-8fef-001a4aab830c", 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "health": { 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "checks": {}, 2021-02-10T23:42:24.171 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mutes": [] 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum": [ 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 0 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_names": [ 2021-02-10T23:42:24.172 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "a" 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_age": 2, 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "monmap": { 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_mons": 1 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.173 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osdmap": { 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_osds": 0, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-02-10T23:42:24.174 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgmap": { 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pools": 0, 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_objects": 0, 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-02-10T23:42:24.175 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_total": 0 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsmap": { 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "by_rank": [], 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "up:standby": 0 2021-02-10T23:42:24.176 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mgrmap": { 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "available": false, 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modules": [ 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "iostat", 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "restful" 2021-02-10T23:42:24.177 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:24.178 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:24.178 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.178 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "servicemap": { 2021-02-10T23:42:24.178 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:24.180 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modified": "2021-02-10T23:42:16.946299+0000", 2021-02-10T23:42:24.180 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:24.180 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:24.181 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "progress_events": {} 2021-02-10T23:42:24.181 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:24.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:24 gibba001 conmon[29242]: audit 2021-02-10T23:42:24.164412+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.2.101:0/1164107047' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-02-10T23:42:24.760 INFO:teuthology.orchestra.run.gibba001.stderr:mgr not available, waiting (1/15)... 2021-02-10T23:42:26.762 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 status -f json-pretty 2021-02-10T23:42:27.405 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsid": "7788ccb8-6bf9-11eb-8fef-001a4aab830c", 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "health": { 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "checks": {}, 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mutes": [] 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum": [ 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 0 2021-02-10T23:42:27.406 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_names": [ 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "a" 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_age": 5, 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "monmap": { 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_mons": 1 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osdmap": { 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_osds": 0, 2021-02-10T23:42:27.407 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-02-10T23:42:27.408 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-02-10T23:42:27.408 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-02-10T23:42:27.408 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-02-10T23:42:27.410 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-02-10T23:42:27.410 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.410 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgmap": { 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pools": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_objects": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_total": 0 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsmap": { 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "by_rank": [], 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "up:standby": 0 2021-02-10T23:42:27.411 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mgrmap": { 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "available": false, 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modules": [ 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "iostat", 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "restful" 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "servicemap": { 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modified": "2021-02-10T23:42:16.946299+0000", 2021-02-10T23:42:27.412 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:27.413 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:27.413 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "progress_events": {} 2021-02-10T23:42:27.413 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: cluster 2021-02-10T23:42:27.259446+0000 mon.a (mon.0) 8 : cluster [INF] Activating manager daemon x 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: cluster 2021-02-10T23:42:27.261344+0000 mon.a (mon.0) 9 : cluster [DBG] mgrmap e2: x(active, starting, since 0.00197159s) 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.262310+0000 mon.a (mon.0) 10 : audit [DBG] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.262407+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.262488+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.262900+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.263073+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: cluster 2021-02-10T23:42:27.264830+0000 mon.a (mon.0) 15 : cluster [INF] Manager daemon x is now available 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.271410+0000 mon.a (mon.0) 16 : audit [INF] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.274714+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:42:27.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.275702+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:42:27.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.279780+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:27.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.282221+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:27.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:27 gibba001 conmon[29242]: audit 2021-02-10T23:42:27.405450+0000 mon.a (mon.0) 21 : audit [DBG] from='client.? 172.21.2.101:0/2089254189' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-02-10T23:42:27.924 INFO:teuthology.orchestra.run.gibba001.stderr:mgr not available, waiting (2/15)... 2021-02-10T23:42:29.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:29 gibba001 conmon[29242]: cluster 2021-02-10T23:42:28.263989+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: x(active, since 1.0046s) 2021-02-10T23:42:29.927 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 status -f json-pretty 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsid": "7788ccb8-6bf9-11eb-8fef-001a4aab830c", 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "health": { 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "checks": {}, 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mutes": [] 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.644 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum": [ 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 0 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_names": [ 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "a" 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "quorum_age": 9, 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "monmap": { 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_mons": 1 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.645 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osdmap": { 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_osds": 0, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.646 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgmap": { 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_pools": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_objects": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "bytes_total": 0 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "fsmap": { 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "by_rank": [], 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "up:standby": 0 2021-02-10T23:42:30.647 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mgrmap": { 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "available": true, 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modules": [ 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "iostat", 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "restful" 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ], 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "servicemap": { 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 1, 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "modified": "2021-02-10T23:42:16.946299+0000", 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "services": {} 2021-02-10T23:42:30.648 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: }, 2021-02-10T23:42:30.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "progress_events": {} 2021-02-10T23:42:30.649 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:31.157 INFO:teuthology.orchestra.run.gibba001.stderr:mgr is available 2021-02-10T23:42:31.157 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config-key set mgr/cephadm/ssh_user root 2021-02-10T23:42:31.422 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:31 gibba001 conmon[29242]: cluster 2021-02-10T23:42:30.264945+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: x(active, since 3s) 2021-02-10T23:42:31.422 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:31 gibba001 conmon[29242]: audit 2021-02-10T23:42:30.641000+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.2.101:0/2764592211' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-02-10T23:42:31.963 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: set mgr/cephadm/ssh_user 2021-02-10T23:42:32.512 INFO:teuthology.orchestra.run.gibba001.stderr:Enabling cephadm module... 2021-02-10T23:42:32.513 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 mgr module enable cephadm 2021-02-10T23:42:33.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:32 gibba001 conmon[29242]: audit 2021-02-10T23:42:31.962797+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.2.101:0/167872716' entity='client.admin' 2021-02-10T23:42:34.440 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 mgr stat 2021-02-10T23:42:34.443 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:33 gibba001 conmon[29242]: audit 2021-02-10T23:42:33.240893+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.2.101:0/204713352' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-02-10T23:42:34.444 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:33 gibba001 conmon[29628]: ignoring --setuser ceph since I am not root 2021-02-10T23:42:34.444 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:33 gibba001 conmon[29628]: ignoring --setgroup ceph since I am not root 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 5, 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "available": true, 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "active_name": "x", 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_standby": 0 2021-02-10T23:42:35.259 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:35.277 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:34 gibba001 conmon[29242]: audit 2021-02-10T23:42:33.967035+0000 mon.a (mon. 2021-02-10T23:42:35.277 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:34 gibba001 conmon[29242]: 0) 27 : audit [INF] from='client.? 172.21.2.101:0/204713352' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-02-10T23:42:35.277 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:34 gibba001 conmon[29242]: cluster 2021-02-10T23:42:33.967082+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: x(active, since 6s) 2021-02-10T23:42:35.783 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for the mgr to restart... 2021-02-10T23:42:35.784 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mgr epoch 5... 2021-02-10T23:42:35.784 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 tell mgr mgr_status 2021-02-10T23:42:36.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:35 gibba001 conmon[29242]: audit 2021-02-10T23:42:35.260399+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.2.101:0/4180911891' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-02-10T23:42:38.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:37 gibba001 conmon[29242]: cluster 2021-02-10T23:42:37.784172+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon x restarted 2021-02-10T23:42:38.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:37 gibba001 conmon[29242]: cluster 2021-02-10T23:42:37.784637+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon x 2021-02-10T23:42:38.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:37 gibba001 conmon[29242]: cluster 2021-02-10T23:42:37.785974+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-02-10T23:42:38.847 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:38.847 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-02-10T23:42:38.847 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "initialized": true 2021-02-10T23:42:38.847 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: cluster 2021-02-10T23:42:37.837769+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: x(active, starting, since 0.0532154s) 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.840084+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.840942+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.841097+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.841254+0000 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: mon.a (mon.0) 37 : audit [DBG] 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: 2021-02-10T23:42:37 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: .841661+0000 mon.a (mon.0) 38 : audit [DBG] 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.842295 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: +0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: .842741+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.843046+0000 mon.a 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.843415+0000 mon.a (mon 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: .0) 42 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: cluster 2021-02-10T23:42:37.845176+0000 mon.a (mon.0 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: ) 43 : cluster [INF] Manager daemon x is now available 2021-02-10T23:42:39.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.855199+0000 mon.a (mon.0 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: ) 44 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: 2021-02-10T23:42:37.857372+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42: 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: 37.859424+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42: 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: 37.935583+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: :37.940490+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42: 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: 37.944812+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: audit 2021-02-10T23:42:37.945872+0000 2021-02-10T23:42:39.212 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:38 gibba001 conmon[29242]: mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:42:39.387 INFO:teuthology.orchestra.run.gibba001.stderr:mgr epoch 5 is available 2021-02-10T23:42:39.388 INFO:teuthology.orchestra.run.gibba001.stderr:Setting orchestrator backend to cephadm... 2021-02-10T23:42:39.388 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 orch set backend cephadm 2021-02-10T23:42:40.128 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:39 gibba001 conmon[29242]: audit 2021-02-10T23:42:38.841624+0000 mgr.x (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-02-10T23:42:40.128 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:39 gibba001 conmon[29242]: cluster 2021-02-10T23:42:38.842188+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: x(active, since 1.05762s) 2021-02-10T23:42:40.128 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:39 gibba001 conmon[29242]: audit 2021-02-10T23:42:38.848202+0000 mgr.x (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-02-10T23:42:40.668 INFO:teuthology.orchestra.run.gibba001.stderr:Generating ssh key... 2021-02-10T23:42:40.669 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 cephadm generate-key 2021-02-10T23:42:40.920 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:40 gibba001 conmon[29242]: cluster 2021-02-10T23:42:39.846221+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: x(active, since 2s) 2021-02-10T23:42:40.920 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:40 gibba001 conmon[29242]: audit 2021-02-10T23:42:40.102861+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:40.920 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:40 gibba001 conmon[29242]: audit 2021-02-10T23:42:40.107826+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: Generating public/private rsa key pair. 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: Your identification has been saved in /tmp/tmpzf9lql3c/key. 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: Your public key has been saved in /tmp/tmpzf9lql3c/key.pub. 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: The key fingerprint is: 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: SHA256:RNXes8O50xrgXrp1p6QSO7xjSxDLVw0E2vKCFmDTm2Y ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: The key's randomart image is: 2021-02-10T23:42:41.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: +---[RSA 3072]----+ 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | +. ..o+o | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | . o.. o .o | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | .o= ..... | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | E= = .. o | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | oo S o .. + | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | . +.. .= | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | ..o. =+o| 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | .B. *o+o| 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: | .o*=.oo | 2021-02-10T23:42:41.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29628]: +----[SHA256]-----+ 2021-02-10T23:42:41.985 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 cephadm get-pub-key 2021-02-10T23:42:42.170 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29242]: audit 2021-02-10T23:42:40.099257+0000 mgr.x (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:42.170 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29242]: audit 2021-02-10T23:42:41.429031+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:42.170 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:41 gibba001 conmon[29242]: audit 2021-02-10T23:42:41.430799+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:42.693 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDH7lzNH59RoHHUUWFFFDBQadCbfhGSvi5wOCl47dgaH3U5RZGGHg9I4L1ekf7U0e0j8YSMYiGG22VCNmOx77owa3kENkUgvLWnOXH7DuVquZnn10L60IRxn5VVkRr66sJEOywGEuhwI0ms+RLM+OybR0US2ruAItK50c+UyxdwhzM5DTj38+SC94oeJxsG4l/m04KDBdOvnASO2qDvjjmGCH8aYViENgzAolZlPDha4y6Tqk5grQjBKQOZZgJuk2w7NU4TrJzhKMyEVWv5C2ZisinADj90gTidMjL2bx6Lo5+MYmc3hOqNituv3LEJHS7AvAM/KMzuPL4nmyEjSjGZ/+DEm9+nW1/G6ajt/wj+sV+3F+09olpkRU2HOP2nx0KzW4r+W59FmK4XlX2RJN3ai+TdiV28RO6RX4gl4I9Ulj0oTNUX5EzPrU+ZJkMmtj+YHhe7SCkpgmK8kbjR7lHodGTzJp6KSk3YVXRM7mNwYg0Rw+thXwpSclAjU4ysOX0= ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:43.176 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:42 gibba001 conmon[29242]: audit 2021-02-10T23:42:41.389061+0000 mgr.x (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:43.176 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:42 gibba001 conmon[29242]: cephadm 2021-02-10T23:42:41.389285+0000 mgr.x (mgr.14116) 5 2021-02-10T23:42:43.176 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:42 gibba001 conmon[29242]: : cephadm [INF] Generating ssh key... 2021-02-10T23:42:43.177 INFO:teuthology.orchestra.run.gibba001.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-02-10T23:42:43.177 INFO:teuthology.orchestra.run.gibba001.stderr:Adding key to root@localhost's authorized_keys... 2021-02-10T23:42:43.179 INFO:teuthology.orchestra.run.gibba001.stderr:Adding host gibba001... 2021-02-10T23:42:43.179 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 orch host add gibba001 2021-02-10T23:42:44.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:43 gibba001 conmon[29242]: audit 2021-02-10T23:42:42.694672+0000 mgr.x (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:44.210 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:43 gibba001 conmon[29628]: [88B blob data] 2021-02-10T23:42:44.379 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: Added host 'gibba001' 2021-02-10T23:42:45.007 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config set mgr mgr/cephadm/container_init True --force 2021-02-10T23:42:45.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:44 gibba001 conmon[29242]: audit 2021-02-10T23:42:43.899653+0000 mgr.x (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "gibba001", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:45.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:44 gibba001 conmon[29242]: audit 2021-02-10T23:42:44.378608+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:45.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:44 gibba001 conmon[29242]: audit 2021-02-10T23:42:44.613301+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:45.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:44 gibba001 conmon[29242]: audit 2021-02-10T23:42:44.613913+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:42:46.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:45 gibba001 conmon[29242]: cephadm 2021-02-10T23:42:44.378977+0000 mgr.x (mgr.14116) 8 : cephadm [INF] Added host gibba001 2021-02-10T23:42:46.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:45 gibba001 conmon[29242]: audit 2021-02-10T23:42:45.737855+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:46.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:45 gibba001 conmon[29242]: audit 2021-02-10T23:42:45.738455+0000 mon.a (mon.0) 61 : audit [DBG] 2021-02-10T23:42:46.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:45 gibba001 conmon[29242]: from='mgr.14116 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:42:46.540 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config set mgr mgr/dashboard/ssl_server_port 8443 2021-02-10T23:42:47.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:46 gibba001 conmon[29242]: audit 2021-02-10T23:42:45.870088+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.2.101:0/3319630752' entity='client.admin' 2021-02-10T23:42:47.885 INFO:teuthology.orchestra.run.gibba001.stderr:Enabling the dashboard module... 2021-02-10T23:42:47.886 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 mgr module enable dashboard 2021-02-10T23:42:48.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:48 gibba001 conmon[29242]: audit 2021-02-10T23:42:47.377299+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.2.101:0/3320192122' entity='client.admin' 2021-02-10T23:42:49.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:49 gibba001 conmon[29242]: audit 2021-02-10T23:42:48.622777+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.2.101:0/4233261982' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-02-10T23:42:49.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:49 gibba001 conmon[29628]: ignoring --setuser ceph since I am not root 2021-02-10T23:42:49.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:49 gibba001 conmon[29628]: ignoring --setgroup ceph since I am not root 2021-02-10T23:42:49.944 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 mgr stat 2021-02-10T23:42:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:50 gibba001 conmon[29242]: audit 2021-02-10T23:42:49.381397+0000 mon.a (mon.0) 65 2021-02-10T23:42:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:50 gibba001 conmon[29242]: : audit [INF] from='client.? 172.21.2.101:0/4233261982' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-02-10T23:42:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:50 gibba001 conmon[29242]: cluster 2021-02-10T23:42:49.381439+0000 mon.a (mon.0) 66 : cluster [DBG] mgrmap e9: x(active, since 11s) 2021-02-10T23:42:50.716 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:50.716 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "epoch": 9, 2021-02-10T23:42:50.716 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "available": true, 2021-02-10T23:42:50.716 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "active_name": "x", 2021-02-10T23:42:50.716 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "num_standby": 0 2021-02-10T23:42:50.717 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:51.268 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for the mgr to restart... 2021-02-10T23:42:51.268 INFO:teuthology.orchestra.run.gibba001.stderr:Waiting for mgr epoch 9... 2021-02-10T23:42:51.269 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 tell mgr mgr_status 2021-02-10T23:42:51.530 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:51 gibba001 conmon[29242]: audit 2021-02-10T23:42:50.717613+0000 mon.a (mon.0) 67 : audit [DBG] from='client.? 172.21.2.101:0/2668303091' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-02-10T23:42:53.709 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:42:53 gibba001 conmon[29628]: [88B blob data] 2021-02-10T23:42:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:53 gibba001 conmon[29242]: cluster 2021-02-10T23:42:53.193042+0000 mon.a (mon.0) 68 : cluster [INF] Active manager daemon x restarted 2021-02-10T23:42:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:53 gibba001 conmon[29242]: cluster 2021-02-10T23:42:53.193686+0000 mon.a (mon.0) 69 : cluster [INF] Activating manager daemon x 2021-02-10T23:42:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:53 gibba001 conmon[29242]: cluster 2021-02-10T23:42:53.195145+0000 mon.a (mon.0) 70 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-02-10T23:42:54.256 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: { 2021-02-10T23:42:54.256 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-02-10T23:42:54.257 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: "initialized": true 2021-02-10T23:42:54.257 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: } 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: cluster 2021-02-10T23:42:53.246862+0000 mon.a (mon.0) 71 : cluster [DBG] mgrmap e10: x(active, starting, since 0.0533198s) 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.248993+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.249365+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.249475+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.249572+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.249928+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.250558+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.gibba001"}]: dispatch 2021-02-10T23:42:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.250866+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.251101+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: -02-10T23:42:53.251484+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.251784+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.252008+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.252273+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.252550+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.252796+0000 mon.a (mon.0) 85 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: cluster 2021-02-10T23:42:53.254402+0000 mon.a (mon.0) 86 : cluster [INF] Manager daemon x is now available 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.351238+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.352403+0000 mon.a (mon.0) 88 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:53.532083+0000 mon.a (mon.0) 89 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:42:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:54.221827+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:54.712 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:54 gibba001 conmon[29242]: audit 2021-02-10T23:42:54.222434+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:42:54.875 INFO:teuthology.orchestra.run.gibba001.stderr:mgr epoch 9 is available 2021-02-10T23:42:54.875 INFO:teuthology.orchestra.run.gibba001.stderr:Generating a dashboard self-signed certificate... 2021-02-10T23:42:54.875 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 dashboard create-self-signed-cert 2021-02-10T23:42:55.406 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:55 gibba001 conmon[29242]: cluster 2021-02-10T23:42:54.250844+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e11: x(active, since 1.0573s) 2021-02-10T23:42:55.406 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:55 gibba001 conmon[29242]: audit 2021-02-10T23:42:54.250916+0000 mgr.x (mgr.14140) 1 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-02-10T23:42:55.407 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:55 gibba001 conmon[29242]: audit 2021-02-10T23:42:54.257561+0000 mgr.x (mgr.14140) 2 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-02-10T23:42:55.939 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: Self-signed certificate created 2021-02-10T23:42:56.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:56 gibba001 conmon[29242]: cluster 2021-02-10T23:42:55.253553+0000 mon.a (mon.0) 93 : cluster [DBG] mgrmap e12: x(active, since 2s) 2021-02-10T23:42:56.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:56 gibba001 conmon[29242]: audit 2021-02-10T23:42:55.938997+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:56.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:56 gibba001 conmon[29242]: audit 2021-02-10T23:42:55.940772+0000 mon.a (mon.0) 95 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:56.504 INFO:teuthology.orchestra.run.gibba001.stderr:Creating initial admin user... 2021-02-10T23:42:56.504 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmp3grch3dd:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-02-10T23:42:57.357 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$0cGgcoImnTS2ZeChWTT9He4KVfPmB6eZ93ot9apBhli28zwEFNxOy", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1613000577, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-02-10T23:42:57.514 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:57 gibba001 conmon[29242]: audit 2021-02-10T23:42:55.884538+0000 mgr.x (mgr.14140) 3 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:57.877 INFO:teuthology.orchestra.run.gibba001.stderr:Fetching dashboard port number... 2021-02-10T23:42:57.878 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /bin/podman run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 -e NODE_NAME=gibba001 -v /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmpjicp1x19:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp4bcgsugb:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 config get mgr mgr/dashboard/ssl_server_port 2021-02-10T23:42:58.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:58 gibba001 conmon[29242]: audit 2021-02-10T23:42:57.195256+0000 mgr.x (mgr.14140) 4 : audit [DBG] from='client.14152 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:42:58.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:58 gibba001 conmon[29242]: audit 2021-02-10T23:42:57.358724+0000 2021-02-10T23:42:58.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:58 gibba001 conmon[29242]: mon.a (mon.0) 96 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:42:58.583 INFO:teuthology.orchestra.run.gibba001.stderr:/usr/bin/ceph: 8443 2021-02-10T23:42:59.110 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-enabled firewalld.service 2021-02-10T23:42:59.116 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: disabled 2021-02-10T23:42:59.117 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: systemctl is-active firewalld.service 2021-02-10T23:42:59.121 INFO:teuthology.orchestra.run.gibba001.stderr:systemctl: inactive 2021-02-10T23:42:59.121 INFO:teuthology.orchestra.run.gibba001.stderr:firewalld.service is not enabled 2021-02-10T23:42:59.122 INFO:teuthology.orchestra.run.gibba001.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-02-10T23:42:59.123 INFO:teuthology.orchestra.run.gibba001.stderr:Ceph Dashboard is now available at: 2021-02-10T23:42:59.123 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.123 INFO:teuthology.orchestra.run.gibba001.stderr: URL: https://gibba001:8443/ 2021-02-10T23:42:59.123 INFO:teuthology.orchestra.run.gibba001.stderr: User: admin 2021-02-10T23:42:59.123 INFO:teuthology.orchestra.run.gibba001.stderr: Password: wjwm5i6ekw 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr:You can access the Ceph CLI with: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr:Please consider enabling telemetry to help improve Ceph: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: ceph telemetry on 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr:For more information see: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-02-10T23:42:59.124 INFO:teuthology.orchestra.run.gibba001.stderr: 2021-02-10T23:42:59.125 INFO:teuthology.orchestra.run.gibba001.stderr:Bootstrap complete. 2021-02-10T23:42:59.125 INFO:teuthology.orchestra.run.gibba001.stderr:Releasing lock 140543330888112 on /run/cephadm/7788ccb8-6bf9-11eb-8fef-001a4aab830c.lock 2021-02-10T23:42:59.125 INFO:teuthology.orchestra.run.gibba001.stderr:Lock 140543330888112 released on /run/cephadm/7788ccb8-6bf9-11eb-8fef-001a4aab830c.lock 2021-02-10T23:42:59.147 INFO:tasks.cephadm:Fetching config... 2021-02-10T23:42:59.148 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:42:59.148 DEBUG:teuthology.orchestra.run.gibba001:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-02-10T23:42:59.159 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-02-10T23:42:59.159 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:42:59.159 DEBUG:teuthology.orchestra.run.gibba001:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-02-10T23:42:59.210 INFO:tasks.cephadm:Fetching mon keyring... 2021-02-10T23:42:59.210 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:42:59.210 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd if=/var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-02-10T23:42:59.270 INFO:tasks.cephadm:Fetching pub ssh key... 2021-02-10T23:42:59.270 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:42:59.270 DEBUG:teuthology.orchestra.run.gibba001:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-02-10T23:42:59.321 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-02-10T23:42:59.321 DEBUG:teuthology.orchestra.run.gibba001:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDH7lzNH59RoHHUUWFFFDBQadCbfhGSvi5wOCl47dgaH3U5RZGGHg9I4L1ekf7U0e0j8YSMYiGG22VCNmOx77owa3kENkUgvLWnOXH7DuVquZnn10L60IRxn5VVkRr66sJEOywGEuhwI0ms+RLM+OybR0US2ruAItK50c+UyxdwhzM5DTj38+SC94oeJxsG4l/m04KDBdOvnASO2qDvjjmGCH8aYViENgzAolZlPDha4y6Tqk5grQjBKQOZZgJuk2w7NU4TrJzhKMyEVWv5C2ZisinADj90gTidMjL2bx6Lo5+MYmc3hOqNituv3LEJHS7AvAM/KMzuPL4nmyEjSjGZ/+DEm9+nW1/G6ajt/wj+sV+3F+09olpkRU2HOP2nx0KzW4r+W59FmK4XlX2RJN3ai+TdiV28RO6RX4gl4I9Ulj0oTNUX5EzPrU+ZJkMmtj+YHhe7SCkpgmK8kbjR7lHodGTzJp6KSk3YVXRM7mNwYg0Rw+thXwpSclAjU4ysOX0= ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-02-10T23:42:59.364 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:42:59 gibba001 conmon[29242]: audit 2021-02-10T23:42:58.584257+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.2.101:0/2347208967' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-02-10T23:42:59.388 INFO:teuthology.orchestra.run.gibba001.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDH7lzNH59RoHHUUWFFFDBQadCbfhGSvi5wOCl47dgaH3U5RZGGHg9I4L1ekf7U0e0j8YSMYiGG22VCNmOx77owa3kENkUgvLWnOXH7DuVquZnn10L60IRxn5VVkRr66sJEOywGEuhwI0ms+RLM+OybR0US2ruAItK50c+UyxdwhzM5DTj38+SC94oeJxsG4l/m04KDBdOvnASO2qDvjjmGCH8aYViENgzAolZlPDha4y6Tqk5grQjBKQOZZgJuk2w7NU4TrJzhKMyEVWv5C2ZisinADj90gTidMjL2bx6Lo5+MYmc3hOqNituv3LEJHS7AvAM/KMzuPL4nmyEjSjGZ/+DEm9+nW1/G6ajt/wj+sV+3F+09olpkRU2HOP2nx0KzW4r+W59FmK4XlX2RJN3ai+TdiV28RO6RX4gl4I9Ulj0oTNUX5EzPrU+ZJkMmtj+YHhe7SCkpgmK8kbjR7lHodGTzJp6KSk3YVXRM7mNwYg0Rw+thXwpSclAjU4ysOX0= ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:42:59.398 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-02-10T23:43:00.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:00 gibba001 conmon[29242]: cluster 2021-02-10T23:42:59.362535+0000 mon.a (mon.0) 98 : cluster [DBG] mgrmap e13: x(active, since 6s) 2021-02-10T23:43:02.180 INFO:tasks.cephadm:Setting crush tunables to default 2021-02-10T23:43:02.180 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd crush tunables default 2021-02-10T23:43:02.818 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:02 gibba001 conmon[29242]: audit 2021-02-10T23:43:01.502837+0000 mon.a (mon.0) 99 : audit [INF] from='client.? 172.21.2.101:0/4165097350' entity='client.admin' 2021-02-10T23:43:03.793 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:02.841167+0000 mon.a (mon.0) 100 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:03.793 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:03.059506+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:03.794 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:03.059802+0000 mgr.x (mgr.14140) 2021-02-10T23:43:03.794 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: 5 : cephadm [INF] Refreshing gibba001 facts 2021-02-10T23:43:03.794 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:03.313006+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:03.794 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:03.313310+0000 mgr.x (mgr.14140) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-02-10T23:43:03.794 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:03.313570+0000 mon.a (mon.0) 103 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-02-10T23:43:03.795 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:03.314144+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:03.795 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:03.314507+0000 mgr.x (mgr.14140) 7 : cephadm [INF] Reconfiguring daemon mon.a on gibba001 2021-02-10T23:43:03.795 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:03 gibba001 conmon[29242]: audit 2021-02-10T23:43:03.314702+0000 mon.a (mon.0) 105 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-02-10T23:43:04.506 INFO:teuthology.orchestra.run.gibba001.stderr:adjusted tunables profile to default 2021-02-10T23:43:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:04 gibba001 conmon[29242]: audit 2021-02-10T23:43:04.338952+0000 mon.a (mon.0) 106 : audit [INF] from='client.? 172.21.2.101:0/268229480' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-02-10T23:43:05.190 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-02-10T23:43:05.190 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph config generate-minimal-conf 2021-02-10T23:43:05.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: audit 2021-02-10T23:43:04.506511+0000 mon.a (mon.0) 107 : audit [INF] from='client.? 172.21.2.101:0/268229480' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: cluster 2021-02-10T23:43:04.506541+0000 mon.a (mon.0) 108 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: audit 2021-02-10T23:43:05.047396+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:05.047797+0000 mgr.x (mgr.14140) 8 : cephadm [INF] Reconfiguring mgr.x (unknown last config time)... 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: audit 2021-02-10T23:43:05.047945+0000 mon.a (mon.0) 110 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mgr.x"}]: dispatch 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: audit 2021-02-10T23:43:05.048450+0000 mon.a (mon.0) 111 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:05.048975+0000 mgr.x (mgr.14140) 9 : cephadm [INF] Reconfiguring daemon mgr.x on gibba001 2021-02-10T23:43:05.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:05 gibba001 conmon[29242]: audit 2021-02-10T23:43:05.049260+0000 mon.a (mon.0) 112 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-02-10T23:43:07.290 INFO:teuthology.orchestra.run.gibba001.stdout:# minimal ceph.conf for 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:43:07.290 INFO:teuthology.orchestra.run.gibba001.stdout:[global] 2021-02-10T23:43:07.290 INFO:teuthology.orchestra.run.gibba001.stdout: fsid = 7788ccb8-6bf9-11eb-8fef-001a4aab830c 2021-02-10T23:43:07.290 INFO:teuthology.orchestra.run.gibba001.stdout: mon_host = [v2:172.21.2.101:3300/0,v1:172.21.2.101:6789/0] 2021-02-10T23:43:08.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:07 gibba001 conmon[29242]: audit 2021-02-10T23:43:06.772797+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:08.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:07 gibba001 conmon[29242]: audit 2021-02-10T23:43:06.774039+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:08.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:07 gibba001 conmon[29242]: audit 2021-02-10T23:43:07.291798+0000 mon.a (mon.0) 115 : audit [DBG] from='client.? 172.21.2.101:0/966671190' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:08.053 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-02-10T23:43:08.053 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:43:08.053 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/ceph/ceph.conf 2021-02-10T23:43:08.074 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:43:08.074 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-02-10T23:43:08.132 INFO:tasks.cephadm:Adding mgr.x on gibba001 2021-02-10T23:43:08.133 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph orch apply mgr '2;gibba001=x' 2021-02-10T23:43:09.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:09 gibba001 conmon[29242]: audit 2021-02-10T23:43:08.086011+0000 mon.a (mon.0) 116 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:09.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:09 gibba001 conmon[29242]: audit 2021-02-10T23:43:08.087900+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:09.951 INFO:teuthology.orchestra.run.gibba001.stdout:Scheduled mgr update... 2021-02-10T23:43:10.553 INFO:tasks.cephadm:Deploying OSDs... 2021-02-10T23:43:10.553 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:43:10.553 DEBUG:teuthology.orchestra.run.gibba001:> dd if=/scratch_devs of=/dev/stdout 2021-02-10T23:43:10.564 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-02-10T23:43:10.564 DEBUG:teuthology.orchestra.run.gibba001:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Device: 6h/6d Inode: 116988 Links: 1 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Context: system_u:object_r:device_t:s0 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Access: 2021-02-10 23:43:02.240787529 +0000 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Modify: 2021-02-10 23:38:03.570016973 +0000 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout:Change: 2021-02-10 23:38:03.570016973 +0000 2021-02-10T23:43:10.616 INFO:teuthology.orchestra.run.gibba001.stdout: Birth: - 2021-02-10T23:43:10.625 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records in 2021-02-10T23:43:10.625 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records out 2021-02-10T23:43:10.625 INFO:teuthology.orchestra.run.gibba001.stderr:512 bytes copied, 0.000161557 s, 3.2 MB/s 2021-02-10T23:43:10.628 DEBUG:teuthology.orchestra.run.gibba001:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-02-10T23:43:10.678 INFO:teuthology.orchestra.run.gibba001.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Device: 6h/6d Inode: 117766 Links: 1 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Context: system_u:object_r:device_t:s0 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Access: 2021-02-10 23:43:02.240787529 +0000 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Modify: 2021-02-10 23:38:03.872017111 +0000 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout:Change: 2021-02-10 23:38:03.872017111 +0000 2021-02-10T23:43:10.679 INFO:teuthology.orchestra.run.gibba001.stdout: Birth: - 2021-02-10T23:43:10.686 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records in 2021-02-10T23:43:10.686 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records out 2021-02-10T23:43:10.686 INFO:teuthology.orchestra.run.gibba001.stderr:512 bytes copied, 0.000127336 s, 4.0 MB/s 2021-02-10T23:43:10.688 DEBUG:teuthology.orchestra.run.gibba001:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-02-10T23:43:10.739 INFO:teuthology.orchestra.run.gibba001.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-02-10T23:43:10.739 INFO:teuthology.orchestra.run.gibba001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-10T23:43:10.739 INFO:teuthology.orchestra.run.gibba001.stdout:Device: 6h/6d Inode: 94929 Links: 1 2021-02-10T23:43:10.739 INFO:teuthology.orchestra.run.gibba001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-10T23:43:10.739 INFO:teuthology.orchestra.run.gibba001.stdout:Context: system_u:object_r:device_t:s0 2021-02-10T23:43:10.740 INFO:teuthology.orchestra.run.gibba001.stdout:Access: 2021-02-10 23:43:02.240787529 +0000 2021-02-10T23:43:10.740 INFO:teuthology.orchestra.run.gibba001.stdout:Modify: 2021-02-10 23:38:04.160017239 +0000 2021-02-10T23:43:10.740 INFO:teuthology.orchestra.run.gibba001.stdout:Change: 2021-02-10 23:38:04.160017239 +0000 2021-02-10T23:43:10.740 INFO:teuthology.orchestra.run.gibba001.stdout: Birth: - 2021-02-10T23:43:10.746 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records in 2021-02-10T23:43:10.746 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records out 2021-02-10T23:43:10.746 INFO:teuthology.orchestra.run.gibba001.stderr:512 bytes copied, 0.000114547 s, 4.5 MB/s 2021-02-10T23:43:10.748 DEBUG:teuthology.orchestra.run.gibba001:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-02-10T23:43:10.798 INFO:teuthology.orchestra.run.gibba001.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Device: 6h/6d Inode: 94958 Links: 1 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Context: system_u:object_r:device_t:s0 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Access: 2021-02-10 23:43:02.240787529 +0000 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Modify: 2021-02-10 23:38:04.444017368 +0000 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout:Change: 2021-02-10 23:38:04.444017368 +0000 2021-02-10T23:43:10.799 INFO:teuthology.orchestra.run.gibba001.stdout: Birth: - 2021-02-10T23:43:10.806 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records in 2021-02-10T23:43:10.806 INFO:teuthology.orchestra.run.gibba001.stderr:1+0 records out 2021-02-10T23:43:10.806 INFO:teuthology.orchestra.run.gibba001.stderr:512 bytes copied, 0.00011319 s, 4.5 MB/s 2021-02-10T23:43:10.808 INFO:tasks.cephadm:Deploying osd.0 on gibba001 with /dev/vg_nvme/lv_4... 2021-02-10T23:43:10.808 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-02-10T23:43:11.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: audit 2021-02-10T23:43:09.949380+0000 mgr.x (mgr.14140) 10 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;gibba001=x", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:43:11.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:09.950421+0000 mgr.x (mgr.14140) 11 : cephadm [INF] Saving service mgr spec with placement gibba001=x;count:2 2021-02-10T23:43:11.209 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: audit 2021-02-10T23:43:09.952186+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:11.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: audit 2021-02-10T23:43:09.953495+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:11.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: audit 2021-02-10T23:43:10.911635+0000 mon.a (mon.0) 120 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:11.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:10 gibba001 conmon[29242]: audit 2021-02-10T23:43:10.913730+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:12.609 INFO:teuthology.orchestra.run.gibba001.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-02-10T23:43:12.699 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-02-10T23:43:12.699 INFO:teuthology.orchestra.run.gibba001.stderr: stderr: 10+0 records in 2021-02-10T23:43:12.699 INFO:teuthology.orchestra.run.gibba001.stderr:10+0 records out 2021-02-10T23:43:12.699 INFO:teuthology.orchestra.run.gibba001.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00677071 s, 1.5 GB/s 2021-02-10T23:43:12.699 INFO:teuthology.orchestra.run.gibba001.stderr:--> Zapping successful for: 2021-02-10T23:43:13.128 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph orch daemon add osd gibba001:vg_nvme/lv_4 2021-02-10T23:43:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:14 gibba001 conmon[29242]: cluster 2021-02-10T23:43:13.250901+0000 mgr.x (mgr.14140) 12 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:15.420 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:15 gibba001 conmon[29242]: audit 2021-02-10T23:43:14.712782+0000 mon.a (mon.0) 122 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-02-10T23:43:15.420 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:15 gibba001 conmon[29242]: audit 2021-02-10T23:43:14.714267+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-02-10T23:43:15.420 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:15 gibba001 conmon[29242]: audit 2021-02-10T23:43:14.715174+0000 mon.a (mon.0) 124 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:15.420 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:15 gibba001 conmon[29242]: audit 2021-02-10T23:43:14.716096+0000 mon.a (mon.0) 125 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:16 gibba001 conmon[29242]: audit 2021-02-10T23:43:14.712047+0000 mgr.x (mgr.14140) 13 : audit [DBG] from='client.14164 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba001:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:43:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:16 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:14.714026+0000 mgr.x (mgr.14140) 14 : cephadm [INF] Applying service osd.None on host gibba001... 2021-02-10T23:43:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:16 gibba001 conmon[29242]: cluster 2021-02-10T23:43:15.251095+0000 mgr.x (mgr.14140) 15 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:17.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: audit 2021-02-10T23:43:16.602121+0000 mon.a (mon.0) 126 : audit [INF] from='client.? 172.21.2.101:0/2925576530' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d"}]: dispatch 2021-02-10T23:43:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: audit 2021-02-10T23:43:16.604166+0000 mon.a (mon. 2021-02-10T23:43:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: 0) 127 : audit [INF] from='client.? 172.21.2.101:0/2925576530' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d"}]': finished 2021-02-10T23:43:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: cluster 2021-02-10T23:43:16.604196+0000 mon.a (mon.0) 128 : cluster [DBG] osdmap e5: 1 total, 0 up, 0 in 2021-02-10T23:43:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: audit 2021-02-10T23:43:16.604278+0000 mon.a (mon.0) 129 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-02-10T23:43:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:17 gibba001 conmon[29242]: audit 2021-02-10T23:43:16.976680+0000 mon.a (mon.0) 130 : audit [DBG] from='client.? 172.21.2.101:0/337463172' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-02-10T23:43:18.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:18 gibba001 conmon[29242]: cluster 2021-02-10T23:43:17.251418+0000 mgr.x (mgr.14140) 16 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:20.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:20 gibba001 conmon[29242]: cluster 2021-02-10T23:43:19.251951+0000 mgr.x (mgr.14140) 17 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:21.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:21 gibba001 conmon[29242]: audit 2021-02-10T23:43:20.472042+0000 mon.a (mon.0) 131 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:22.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:22 gibba001 conmon[29242]: cluster 2021-02-10T23:43:21.252265+0000 mgr.x (mgr.14140) 18 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:23.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:23 gibba001 conmon[29242]: audit 2021-02-10T23:43:22.755476+0000 mon.a (mon.0) 132 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-02-10T23:43:23.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:23 gibba001 conmon[29242]: audit 2021-02-10T23:43:22.756375+0000 mon.a (mon.0) 133 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:23.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:23 gibba001 conmon[29242]: audit 2021-02-10T23:43:22.757255+0000 mon.a (mon.0 2021-02-10T23:43:23.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:23 gibba001 conmon[29242]: ) 134 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-02-10T23:43:24.695 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:24 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:22.756961+0000 mgr.x (mgr.14140) 19 : cephadm [INF] Deploying daemon osd.0 on gibba001 2021-02-10T23:43:24.695 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:24 gibba001 conmon[29242]: cluster 2021-02-10T23:43:23.252509+0000 mgr.x (mgr.14140) 20 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:25.697 INFO:teuthology.orchestra.run.gibba001.stdout:Created osd(s) 0 on host 'gibba001' 2021-02-10T23:43:26.247 DEBUG:teuthology.orchestra.run.gibba001:osd.0> sudo journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.0.service 2021-02-10T23:43:26.249 INFO:tasks.cephadm:Deploying osd.1 on gibba001 with /dev/vg_nvme/lv_3... 2021-02-10T23:43:26.249 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-02-10T23:43:26.268 INFO:journalctl@ceph.osd.0.gibba001.stdout:-- Logs begin at Wed 2021-02-10 23:32:46 UTC. -- 2021-02-10T23:43:26.441 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:26 gibba001 conmon[29242]: cluster 2021-02-10T23:43:25.252922+0000 mgr.x (mgr.14140) 21 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:26.441 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:26 gibba001 conmon[29242]: audit 2021-02-10T23:43:25.692709+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:26.441 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:26 gibba001 conmon[29242]: audit 2021-02-10 2021-02-10T23:43:26.441 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:26 gibba001 conmon[29242]: T23:43:25.693758+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:26.441 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:26 gibba001 conmon[29242]: audit 2021-02-10T23:43:25.695602+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:27.952 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:27 gibba001 conmon[29242]: audit 2021-02-10T23:43:26.802890+0000 mon.a (mon.0) 138 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:27.952 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:27 gibba001 conmon[29242]: audit 2021-02-10T23:43:26.803542+0000 mon.a (mon.0) 139 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:27.952 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:27 gibba001 conmon[29242]: cluster 2021-02-10T23:43:27.253236+0000 mgr.x (mgr.14140) 22 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:28.512 INFO:teuthology.orchestra.run.gibba001.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-02-10T23:43:28.513 INFO:teuthology.orchestra.run.gibba001.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-02-10T23:43:28.513 INFO:teuthology.orchestra.run.gibba001.stderr: stderr: 10+0 records in 2021-02-10T23:43:28.513 INFO:teuthology.orchestra.run.gibba001.stderr:10+0 records out 2021-02-10T23:43:28.513 INFO:teuthology.orchestra.run.gibba001.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.00771791 s, 1.4 GB/s 2021-02-10T23:43:28.513 INFO:teuthology.orchestra.run.gibba001.stderr:--> Zapping successful for: 2021-02-10T23:43:29.179 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph orch daemon add osd gibba001:vg_nvme/lv_3 2021-02-10T23:43:29.940 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 10 23:43:29 gibba001 conmon[39157]: debug 2021-02-10T23:43:29.662+0000 7f740e8f0200 -1 osd.0 0 log_to_monitors {default=true} 2021-02-10T23:43:30.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:30 gibba001 conmon[29242]: cluster 2021-02-10T23:43:29.253379+0000 mgr.x (mgr.14140) 23 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:30.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:30 gibba001 conmon[29242]: audit 2021-02-10T23:43:29.665788+0000 mon.a (mon.0) 140 : audit [INF] from='osd.0 [v2:172.21.2.101:6802/8,v1:172.21.2.101:6803/8]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:30.306654+0000 mon.a (mon.0) 141 : audit [INF] from='osd.0 [v2:172.21.2.101:6802/8,v1:172.21.2.101:6803/8]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: cluster 2021-02-10T23:43:30.306690+0000 mon.a (mon.0) 142 : cluster [DBG] osdmap e6: 1 total, 0 up, 0 in 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:30.307000+0000 mon.a (mon.0) 143 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:30.308427+0000 mon.a (mon.0) 144 : audit [INF] from='osd.0 [v2:172.21.2.101:6802/8,v1:172.21.2.101:6803/8]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba001", "root=default"]}]: dispatch 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.040749+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.259494+0000 mon.a (mon.0) 146 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.261493+0000 mon.a (mon.0) 147 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:31.309 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.263821+0000 mon.a (mon.0) 148 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:31.709 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[39157]: debug 2021-02-10T23:43:31.312+0000 7f7404e61700 -1 osd.0 0 waiting for initial osdmap 2021-02-10T23:43:31.847 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 10 23:43:31 gibba001 conmon[39157]: debug 2021-02-10T23:43:31.315+0000 7f73fd5d5700 -1 osd.0 7 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-10T23:43:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: cluster 2021-02-10T23:43:31.253571+0000 mgr.x (mgr.14140) 24 : cluster 2021-02-10T23:43:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-02-10T23:43:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:31.257058+0000 mgr.x (mgr.14140) 25 : cephadm [INF] Detected new or changed devices on gibba001 2021-02-10T23:43:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.309417+0000 mon.a (mon.0) 149 : audit [INF] from='osd.0 [v2:172.21.2.101:6802/8,v1:172.21.2.101:6803/8]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0820, "args": ["host=gibba001", "root=default"]}]': finished 2021-02-10T23:43:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: cluster 2021-02-10T23:43:31.309450+0000 mon.a (mon.0) 150 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.309749+0000 mon.a (mon.0) 151 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.313658+0000 mon.a (mon.0) 152 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.567074+0000 mon.a (mon.0) 153 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.568562+0000 mon.a (mon.0) 154 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.569453+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:32 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.570495+0000 mon.a (mon.0) 156 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: cluster 2021-02-10T23:43:30.687698+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: cluster 2021-02-10T23: 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: 43:30.687773+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: audit 2021-02-10T23:43:31.566283+0000 mgr.x (mgr.14140) 26 : audit [DBG] from='client.14173 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "gibba001:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:31.568347+0000 mgr.x (mgr.14140) 27 : cephadm [INF] Applying service osd.None on host gibba001... 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: cluster 2021-02-10T23:43:32.312503+0000 mon.a (mon.0) 157 : cluster [INF] osd.0 [v2:172.21.2.101:6802/8,v1:172.21.2.101:6803/8] boot 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: cluster 2021-02-10T23:43:32.312568+0000 mon.a (mon.0) 158 : cluster [DBG] 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: osdmap e8: 1 total, 1 up, 1 in 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: audit 2021-02-10T23:43 2021-02-10T23:43:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: :32.312955+0000 mon.a (mon.0) 159 : 2021-02-10T23:43:33.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:33 gibba001 conmon[29242]: audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: cluster 2021-02-10T23:43:33.253762+0000 mgr.x (mgr.14140) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: cluster 2021-02-10T23:43:33.317805+0000 mon.a (mon.0) 160 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: audit 2021-02-10T23:43:33.608363+0000 mon.a (mon.0) 161 : audit [INF] from='client.? 172.21.2.101:0/3486328216' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "5ea2ad55-f257-46d0-9524-06e9bec38404"}]: dispatch 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: audit 2021-02-10T23:43:33.610850+0000 mon.a (mon.0) 162 : audit [INF] from='client.? 172.21.2.101:0/3486328216' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "5ea2ad55-f257-46d0-9524-06e9bec38404"}]': finished 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: cluster 2021-02-10T23:43:33.610877+0000 mon.a (mon.0) 163 : cluster [DBG] osdmap e10: 2 total, 1 up, 1 in 2021-02-10T23:43:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: audit 2021-02-10T23:43:33.610961+0000 mon.a (mon.0) 164 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-02-10T23:43:34.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:34 gibba001 conmon[29242]: audit 2021-02-10T23:43:34.013121+0000 mon.a (mon.0) 165 : audit [DBG] from='client.? 172.21.2.101:0/2991407544' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-02-10T23:43:36.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:36 gibba001 conmon[29242]: cluster 2021-02-10T23:43:35.254141+0000 mgr.x (mgr.14140) 29 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:37.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:37 gibba001 conmon[29242]: cluster 2021-02-10T23:43:37.254464+0000 mgr.x (mgr.14140) 30 : cluster [DBG] pgmap v22: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:37.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:37 gibba001 conmon[29242]: audit 2021-02-10T23:43:37.563924+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:40.655 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:40 gibba001 conmon[29242]: cluster 2021-02-10T23:43:39.254651+0000 mgr.x (mgr.14140) 31 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:40.655 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:40 gibba001 conmon[29242]: audit 2021-02-10T23:43:39.972594+0000 mon.a (mon.0) 167 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-02-10T23:43:40.655 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:40 gibba001 conmon[29242]: audit 2021-02-10T23:43:39.973360+0000 mon.a (mon.0) 168 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-02-10T23:43:40.655 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:40 gibba001 conmon[29242]: audit 2021-02-10T23:43:39.974153+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-02-10T23:43:41.679 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:41 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:39.973889+0000 mgr.x (mgr.14140) 32 : cephadm [INF] Deploying daemon osd.1 on gibba001 2021-02-10T23:43:42.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:42 gibba001 conmon[29242]: cluster 2021-02-10T23:43:41.254868+0000 mgr.x (mgr.14140) 33 : cluster [DBG] pgmap v24: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:42.989 INFO:teuthology.orchestra.run.gibba001.stdout:Created osd(s) 1 on host 'gibba001' 2021-02-10T23:43:43.458 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:43 gibba001 conmon[29242]: audit 2021-02-10T23:43:42.984789+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:43.458 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:43 gibba001 conmon[29242]: audit 2021-02-10T23:43:42.985958+0000 mon.a (mon.0) 171 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:43.458 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:43 gibba001 conmon[29242]: audit 2021-02-10T23:43:42.987899+0000 mon.a (mon.0) 172 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:43.605 DEBUG:teuthology.orchestra.run.gibba001:osd.1> sudo journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.1.service 2021-02-10T23:43:44.005 INFO:tasks.cephadm:Setting up client nodes... 2021-02-10T23:43:44.006 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-02-10T23:43:44.026 INFO:journalctl@ceph.osd.1.gibba001.stdout:-- Logs begin at Wed 2021-02-10 23:32:46 UTC. -- 2021-02-10T23:43:44.602 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:44 gibba001 conmon[29242]: cluster 2021-02-10T23:43:43.255006+0000 mgr.x (mgr.14140) 34 : cluster [DBG] pgmap v25: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:44.902 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:44 gibba001 conmon[29242]: audit 2021-02-10T23:43:44.105446+0000 mon.a (mon.0) 173 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:44.902 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:44 gibba001 conmon[29242]: audit 2021-02-10T23:43:44.106122+0000 mon.a (mon.0) 174 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-02-10T23:43:46.411 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:46 gibba001 conmon[29242]: cluster 2021-02-10T23:43:45.255326+0000 mgr.x (mgr.14140) 35 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:46.506 INFO:teuthology.orchestra.run.gibba001.stdout:[client.0] 2021-02-10T23:43:46.506 INFO:teuthology.orchestra.run.gibba001.stdout: key = AQCybyRgakAsHhAA6i37jzHqH8TIOayElT3qBA== 2021-02-10T23:43:47.184 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 10 23:43:46 gibba001 conmon[43594]: debug 2021-02-10T23:43:46.933+0000 7f0f73669200 -1 osd.1 0 log_to_monitors {default=true} 2021-02-10T23:43:47.195 DEBUG:teuthology.orchestra.run.gibba001:> set -ex 2021-02-10T23:43:47.196 DEBUG:teuthology.orchestra.run.gibba001:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-02-10T23:43:47.196 DEBUG:teuthology.orchestra.run.gibba001:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-02-10T23:43:47.225 INFO:tasks.cephadm:Waiting for OSDs to come up 2021-02-10T23:43:47.225 DEBUG:teuthology.orchestra.run.gibba001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-10T23:43:47.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:47 gibba001 conmon[29242]: audit 2021-02-10T23:43:46.506110+0000 mon.a (mon.0) 175 : audit [INF] from='client.? 172.21.2.101:0/3141407493' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-02-10T23:43:47.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:47 gibba001 conmon[29242]: audit 2021-02-10T23:43:46.508042+0000 mon.a (mon.0) 176 : audit [INF] from='client.? 172.21.2.101:0/3141407493' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-02-10T23:43:47.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:47 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:47 gibba001 conmon[29242]: 2021-02-10T23:43:46.937335+0000 mon.a (mon.0) 177 : audit [INF] from='osd.1 [v2:172.21.2.101:6810/7,v1:172.21.2.101:6811/7]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-02-10T23:43:47.502 INFO:teuthology.misc.health.gibba001.stdout: 2021-02-10T23:43:47.502 INFO:teuthology.misc.health.gibba001.stdout:{"epoch":10,"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","created":"2021-02-10T23:42:16.945928+0000","modified":"2021-02-10T23:43:33.608618+0000","last_up_change":"2021-02-10T23:43:32.310016+0000","last_in_change":"2021-02-10T23:43:32.310016+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6802","nonce":8},{"type":"v1","addr":"172.21.2.101:6803","nonce":8}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6804","nonce":8},{"type":"v1","addr":"172.21.2.101:6805","nonce":8}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6808","nonce":8},{"type":"v1","addr":"172.21.2.101:6809","nonce":8}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6806","nonce":8},{"type":"v1","addr":"172.21.2.101:6807","nonce":8}]},"public_addr":"172.21.2.101:6803/8","cluster_addr":"172.21.2.101:6805/8","heartbeat_back_addr":"172.21.2.101:6809/8","heartbeat_front_addr":"172.21.2.101:6807/8","state":["exists","up"]},{"osd":1,"uuid":"5ea2ad55-f257-46d0-9524-06e9bec38404","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:30.687775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.2.101:0/2799635665":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/565140142":"2021-02-11T23:42:37.784185+0000","172.21.2.101:0/189737813":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/891157202":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6801/7":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6800/7":"2021-02-11T23:42:37.784185+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-10T23:43:47.510 DEBUG:teuthology.misc:1 of 2 OSDs are up 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: cluster 2021-02-10T23:43:47.255505+0000 mgr.x (mgr.14140) 36 : cluster [DBG] pgmap v27: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.503782+0000 mon.a (mon.0) 178 : audit [DBG] from='client.? 172.21.2.101:0/969106430' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.636243+0000 mon.a (mon.0) 179 : audit [INF] from='osd.1 [v2:172.21.2.101:6810/7,v1:172.21.2.101:6811/7]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: cluster 2021-02-10T23:43:47.636281+0000 mon.a (mon.0) 180 : cluster [DBG] osdmap e11: 2 total, 1 up, 1 in 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.636395+0000 mon.a (mon.0) 181 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.636852+0000 mon.a (mon.0) 182 : audit [INF] from='osd.1 [v2:172.21.2.101:6810/7,v1:172.21.2.101:6811/7]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba001", "root=default"]}]: dispatch 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:47.822169+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.037893+0000 mon.a (mon.0) 184 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.039751+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:48.639 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.042200+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:43:48.959 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[43594]: debug 2021-02-10T23:43:48.639+0000 7f0f69bda700 -1 osd.1 0 waiting for initial osdmap 2021-02-10T23:43:48.959 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 10 23:43:48 gibba001 conmon[43594]: debug 2021-02-10T23:43:48.642+0000 7f0f64352700 -1 osd.1 12 set_numa_affinity unable to identify public interface 'enp1s0f0' numa node: (0) Success 2021-02-10T23:43:49.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: cephadm 2021-02-10T23:43:48.035524+0000 mgr.x (mgr.14140) 37 : cephadm [INF] Detected new or changed devices on gibba001 2021-02-10T23:43:49.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.638479+0000 mon.a (mon.0) 187 : audit [INF] from='osd.1 [v2:172.21.2.101:6810/7,v1:172.21.2.101:6811/7]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0820, "args": ["host=gibba001", "root=default"]}]': finished 2021-02-10T23:43:49.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: cluster 2021-02-10T23:43:48.638529+0000 mon.a (mon.0) 188 : cluster 2021-02-10T23:43:49.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: [DBG] osdmap e12: 2 total, 1 up, 1 in 2021-02-10T23:43:49.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.638680+0000 mon.a (mon.0) 189 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-02-10T23:43:49.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:49 gibba001 conmon[29242]: audit 2021-02-10T23:43:48.641068+0000 mon.a (mon.0) 190 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-02-10T23:43:50.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: cluster 2021-02-10T23:43:47.920759+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: cluster 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: 2021-02-10T23:43:47.920834+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: cluster 2021-02-10T23:43:49.255847+0000 mgr.x (mgr.14140) 38 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 4.7 MiB used, 84 GiB / 84 GiB avail 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: cluster 2021-02-10T23:43:49.639375+0000 mon.a (mon.0) 191 : cluster [INF] osd.1 [v2:172.21.2.101:6810/7,v1:172.21.2.101:6811/7] boot 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: cluster 2021-02-10T23:43:49.639431+0000 mon.a ( 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: mon.0) 192 : cluster [DBG] osdmap e13: 2 total, 2 up, 2 in 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: audit 2021 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: -02-10T23:43:49.639824+0000 mon.a 2021-02-10T23:43:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:50 gibba001 conmon[29242]: (mon.0) 193 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-02-10T23:43:51.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:51 gibba001 conmon[29242]: cluster 2021-02-10T23:43:50.643170+0000 mon.a (mon.0) 194 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2021-02-10T23:43:51.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:51 gibba001 conmon[29242]: cluster 2021-02-10T23:43:51.256254+0000 mgr.x (mgr.14140) 39 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 9.5 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:43:53.511 DEBUG:teuthology.orchestra.run.gibba001:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2021-02-10T23:43:53.701 INFO:teuthology.misc.health.gibba001.stdout: 2021-02-10T23:43:54.030 INFO:teuthology.misc.health.gibba001.stdout:{"epoch":14,"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","created":"2021-02-10T23:42:16.945928+0000","modified":"2021-02-10T23:43:50.640301+0000","last_up_change":"2021-02-10T23:43:49.636386+0000","last_in_change":"2021-02-10T23:43:49.636386+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6802","nonce":8},{"type":"v1","addr":"172.21.2.101:6803","nonce":8}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6804","nonce":8},{"type":"v1","addr":"172.21.2.101:6805","nonce":8}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6808","nonce":8},{"type":"v1","addr":"172.21.2.101:6809","nonce":8}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6806","nonce":8},{"type":"v1","addr":"172.21.2.101:6807","nonce":8}]},"public_addr":"172.21.2.101:6803/8","cluster_addr":"172.21.2.101:6805/8","heartbeat_back_addr":"172.21.2.101:6809/8","heartbeat_front_addr":"172.21.2.101:6807/8","state":["exists","up"]},{"osd":1,"uuid":"5ea2ad55-f257-46d0-9524-06e9bec38404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6810","nonce":7},{"type":"v1","addr":"172.21.2.101:6811","nonce":7}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6812","nonce":7},{"type":"v1","addr":"172.21.2.101:6813","nonce":7}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6816","nonce":7},{"type":"v1","addr":"172.21.2.101:6817","nonce":7}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6814","nonce":7},{"type":"v1","addr":"172.21.2.101:6815","nonce":7}]},"public_addr":"172.21.2.101:6811/7","cluster_addr":"172.21.2.101:6813/7","heartbeat_back_addr":"172.21.2.101:6817/7","heartbeat_front_addr":"172.21.2.101:6815/7","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:30.687775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:47.920836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.2.101:0/2799635665":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/565140142":"2021-02-11T23:42:37.784185+0000","172.21.2.101:0/189737813":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/891157202":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6801/7":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6800/7":"2021-02-11T23:42:37.784185+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-10T23:43:54.031 DEBUG:teuthology.misc:2 of 2 OSDs are up 2021-02-10T23:43:54.031 INFO:tasks.cephadm:Creating RBD pool 2021-02-10T23:43:54.032 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- sudo ceph --cluster ceph osd pool create rbd 8 2021-02-10T23:43:54.692 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:54 gibba001 conmon[29242]: cluster 2021-02-10T23:43:53.256433+0000 mgr.x (mgr.14140) 40 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 9.5 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:43:54.692 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:54 gibba001 conmon[29242]: audit 2021-02-10T23:43:53.352842+0000 mon.a (mon.0) 195 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:43:54.692 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:54 gibba001 conmon[29242]: audit 2021-02-10T23:43:53.353661+0000 mon.a (mon.0 2021-02-10T23:43:54.693 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:54 gibba001 conmon[29242]: ) 196 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:43:54.693 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:54 gibba001 conmon[29242]: audit 2021-02-10T23:43:53.703602+0000 mon.a (mon.0) 197 : audit [DBG] from='client.? 172.21.2.101:0/3197612912' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-02-10T23:43:56.315 INFO:teuthology.orchestra.run.gibba001.stderr:pool 'rbd' created 2021-02-10T23:43:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:56 gibba001 conmon[29242]: cluster 2021-02-10T23:43:55.256929+0000 mgr.x (mgr.14140) 41 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 9.6 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:43:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:56 gibba001 conmon[29242]: audit 2021-02-10T23:43:55.727177+0000 mon.a (mon.0) 198 : audit [INF] from='client.? 172.21.2.101:0/3606235195' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]: dispatch 2021-02-10T23:43:56.895 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2021-02-10T23:43:57.534 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:57 gibba001 conmon[29242]: audit 2021-02-10T23:43:56.314664+0000 mon.a (mon.0) 199 : audit [INF] from='client.? 172.21.2.101:0/3606235195' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]': finished 2021-02-10T23:43:57.534 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:57 gibba001 conmon[29242]: cluster 2021-02-10T23:43:56.314708+0000 mon.a (mon.0) 200 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2021-02-10T23:43:58.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:58 gibba001 conmon[29242]: cluster 2021-02-10T23:43:57.257199+0000 mgr.x (mgr.14140) 42 : cluster [DBG] pgmap v37: 8 pgs: 8 unknown; 0 B data, 9.6 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:43:58.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:58 gibba001 conmon[29242]: 2021-02-10T23:43:58.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:58 gibba001 conmon[29242]: cluster 2021-02-10T23:43:57.315907+0000 mon.a (mon.0) 201 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-02-10T23:43:59.324 INFO:teuthology.orchestra.run.gibba001.stderr:enabled application 'rbd' on pool 'rbd' 2021-02-10T23:43:59.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:59 gibba001 conmon[29242]: cluster 2021-02-10T23:43:58.318649+0000 mon.a (mon.0) 202 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-02-10T23:43:59.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:43:59 gibba001 conmon[29242]: audit 2021-02-10T23:43:58.629434+0000 mon.a (mon.0) 203 : audit [INF] from='client.? 172.21.2.101:0/3737199699' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]: dispatch 2021-02-10T23:43:59.887 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd dump --format=json 2021-02-10T23:44:00.035 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:00.511 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:00 gibba001 conmon[29242]: cluster 2021-02-10T23:43:59.257544+0000 mgr.x (mgr.14140) 43 : cluster [DBG] pgmap v40: 8 pgs: 2 creating+peering, 6 unknown; 0 B data, 9.6 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:01.004 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:00 gibba001 conmon[29242]: audit 2021-02-10T23:43:59.323860+0000 mon.a (mon.0) 204 : audit [INF] from='client.? 172.21.2.101:0/3737199699' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]': finished 2021-02-10T23:44:01.004 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:00 gibba001 conmon[29242]: cluster 2021-02-10T23:43:59 2021-02-10T23:44:01.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:00 gibba001 conmon[29242]: .323912+0000 mon.a (mon.0) 205 : cluster [DBG] osdmap e18: 2 total, 2 up, 2 in 2021-02-10T23:44:01.528 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:01.528 INFO:teuthology.orchestra.run.gibba001.stdout:{"epoch":18,"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","created":"2021-02-10T23:42:16.945928+0000","modified":"2021-02-10T23:43:59.320114+0000","last_up_change":"2021-02-10T23:43:49.636386+0000","last_in_change":"2021-02-10T23:43:49.636386+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-10T23:43:55.819797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6802","nonce":8},{"type":"v1","addr":"172.21.2.101:6803","nonce":8}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6804","nonce":8},{"type":"v1","addr":"172.21.2.101:6805","nonce":8}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6808","nonce":8},{"type":"v1","addr":"172.21.2.101:6809","nonce":8}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6806","nonce":8},{"type":"v1","addr":"172.21.2.101:6807","nonce":8}]},"public_addr":"172.21.2.101:6803/8","cluster_addr":"172.21.2.101:6805/8","heartbeat_back_addr":"172.21.2.101:6809/8","heartbeat_front_addr":"172.21.2.101:6807/8","state":["exists","up"]},{"osd":1,"uuid":"5ea2ad55-f257-46d0-9524-06e9bec38404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6810","nonce":7},{"type":"v1","addr":"172.21.2.101:6811","nonce":7}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6812","nonce":7},{"type":"v1","addr":"172.21.2.101:6813","nonce":7}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6816","nonce":7},{"type":"v1","addr":"172.21.2.101:6817","nonce":7}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6814","nonce":7},{"type":"v1","addr":"172.21.2.101:6815","nonce":7}]},"public_addr":"172.21.2.101:6811/7","cluster_addr":"172.21.2.101:6813/7","heartbeat_back_addr":"172.21.2.101:6817/7","heartbeat_front_addr":"172.21.2.101:6815/7","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:30.687775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:47.920836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.2.101:0/2799635665":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/565140142":"2021-02-11T23:42:37.784185+0000","172.21.2.101:0/189737813":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/891157202":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6801/7":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6800/7":"2021-02-11T23:42:37.784185+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-10T23:44:02.170 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2021-02-10T23:43:55.819797+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-02-10T23:44:02.170 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd pool get rbd pg_num 2021-02-10T23:44:02.318 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:02.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:02 gibba001 conmon[29242]: cluster 2021-02-10T23:44:01.257787+0000 mgr.x (mgr.14140) 44 : cluster [DBG] pgmap v42: 8 pgs: 6 active+undersized, 2 creating+peering; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:02.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:02 gibba001 conmon[29242]: audit 2021-02-10T23:44:01.529879+0000 mon.a (mon.0) 206 : audit [DBG] from='client.? 172.21.2.101:0/4286674640' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-02-10T23:44:03.861 INFO:teuthology.orchestra.run.gibba001.stdout:pg_num: 8 2021-02-10T23:44:04.457 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-02-10T23:44:04.457 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-02-10T23:44:04.457 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph mgr dump --format=json 2021-02-10T23:44:04.603 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:04 gibba001 conmon[29242]: cluster 2021-02-10T23:44:03.258299+0000 mgr.x (mgr.14140) 45 : cluster [DBG] pgmap v43: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:04 gibba001 conmon[29242]: audit 2021-02-10T23:44:03.863092+0000 mon.a (mon.0) 207 : audit [DBG] from='client.? 172.21.2.101:0/3155723247' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]: dispatch 2021-02-10T23:44:06.143 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:06.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:06 gibba001 conmon[29242]: cluster 2021-02-10T23:44:05.258517+0000 mgr.x (mgr.14140) 46 : cluster [DBG] pgmap v44: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:06.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:06 gibba001 conmon[29242]: audit 2021-02-10T23:44:06.141126+0000 mon.a (mon.0) 208 : audit [DBG] from='client.? 172.21.2.101:0/2930887652' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-02-10T23:44:06.724 INFO:teuthology.orchestra.run.gibba001.stdout:{"epoch":13,"active_gid":14140,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6800","nonce":7},{"type":"v1","addr":"172.21.2.101:6801","nonce":7}]},"active_addr":"172.21.2.101:6801/7","active_change":"2021-02-10T23:42:53.193535+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://gibba001:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.101:0","nonce":762098689}]},{"addrvec":[{"type":"v2","addr":"172.21.2.101:0","nonce":3758844670}]}]}} 2021-02-10T23:44:06.726 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-02-10T23:44:06.726 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-02-10T23:44:06.727 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd dump --format=json 2021-02-10T23:44:06.875 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:07.951 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:07 gibba001 conmon[29242]: cluster 2021-02-10T23:44:07.258746+0000 mgr.x (mgr.14140) 47 : cluster [DBG] pgmap v45: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:08.411 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:08.411 INFO:teuthology.orchestra.run.gibba001.stdout:{"epoch":18,"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","created":"2021-02-10T23:42:16.945928+0000","modified":"2021-02-10T23:43:59.320114+0000","last_up_change":"2021-02-10T23:43:49.636386+0000","last_in_change":"2021-02-10T23:43:49.636386+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-10T23:43:55.819797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6802","nonce":8},{"type":"v1","addr":"172.21.2.101:6803","nonce":8}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6804","nonce":8},{"type":"v1","addr":"172.21.2.101:6805","nonce":8}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6808","nonce":8},{"type":"v1","addr":"172.21.2.101:6809","nonce":8}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6806","nonce":8},{"type":"v1","addr":"172.21.2.101:6807","nonce":8}]},"public_addr":"172.21.2.101:6803/8","cluster_addr":"172.21.2.101:6805/8","heartbeat_back_addr":"172.21.2.101:6809/8","heartbeat_front_addr":"172.21.2.101:6807/8","state":["exists","up"]},{"osd":1,"uuid":"5ea2ad55-f257-46d0-9524-06e9bec38404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6810","nonce":7},{"type":"v1","addr":"172.21.2.101:6811","nonce":7}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6812","nonce":7},{"type":"v1","addr":"172.21.2.101:6813","nonce":7}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6816","nonce":7},{"type":"v1","addr":"172.21.2.101:6817","nonce":7}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6814","nonce":7},{"type":"v1","addr":"172.21.2.101:6815","nonce":7}]},"public_addr":"172.21.2.101:6811/7","cluster_addr":"172.21.2.101:6813/7","heartbeat_back_addr":"172.21.2.101:6817/7","heartbeat_front_addr":"172.21.2.101:6815/7","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:30.687775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:47.920836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.2.101:0/2799635665":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/565140142":"2021-02-11T23:42:37.784185+0000","172.21.2.101:0/189737813":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/891157202":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6801/7":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6800/7":"2021-02-11T23:42:37.784185+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-10T23:44:08.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:08 gibba001 conmon[29242]: audit 2021-02-10T23:44:08.412774+0000 mon.a (mon.0) 209 : audit [DBG] from='client.? 172.21.2.101:0/239420790' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-02-10T23:44:08.974 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-02-10T23:44:08.974 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd dump --format=json 2021-02-10T23:44:09.121 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:09.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:09 gibba001 conmon[29242]: cluster 2021-02-10T23:44:09.259234+0000 mgr.x (mgr.14140) 48 : cluster [DBG] pgmap v46: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:10.617 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:10.617 INFO:teuthology.orchestra.run.gibba001.stdout:{"epoch":18,"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","created":"2021-02-10T23:42:16.945928+0000","modified":"2021-02-10T23:43:59.320114+0000","last_up_change":"2021-02-10T23:43:49.636386+0000","last_in_change":"2021-02-10T23:43:49.636386+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":2,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"rbd","create_time":"2021-02-10T23:43:55.819797+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"80e00d19-3eb0-4b94-bbaa-1a8d552ddb0d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6802","nonce":8},{"type":"v1","addr":"172.21.2.101:6803","nonce":8}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6804","nonce":8},{"type":"v1","addr":"172.21.2.101:6805","nonce":8}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6808","nonce":8},{"type":"v1","addr":"172.21.2.101:6809","nonce":8}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6806","nonce":8},{"type":"v1","addr":"172.21.2.101:6807","nonce":8}]},"public_addr":"172.21.2.101:6803/8","cluster_addr":"172.21.2.101:6805/8","heartbeat_back_addr":"172.21.2.101:6809/8","heartbeat_front_addr":"172.21.2.101:6807/8","state":["exists","up"]},{"osd":1,"uuid":"5ea2ad55-f257-46d0-9524-06e9bec38404","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6810","nonce":7},{"type":"v1","addr":"172.21.2.101:6811","nonce":7}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6812","nonce":7},{"type":"v1","addr":"172.21.2.101:6813","nonce":7}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6816","nonce":7},{"type":"v1","addr":"172.21.2.101:6817","nonce":7}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.101:6814","nonce":7},{"type":"v1","addr":"172.21.2.101:6815","nonce":7}]},"public_addr":"172.21.2.101:6811/7","cluster_addr":"172.21.2.101:6813/7","heartbeat_back_addr":"172.21.2.101:6817/7","heartbeat_front_addr":"172.21.2.101:6815/7","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:30.687775+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-10T23:43:47.920836+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.2.101:0/2799635665":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/565140142":"2021-02-11T23:42:37.784185+0000","172.21.2.101:0/189737813":"2021-02-11T23:42:53.193059+0000","172.21.2.101:0/891157202":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6801/7":"2021-02-11T23:42:37.784185+0000","172.21.2.101:6800/7":"2021-02-11T23:42:37.784185+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-02-10T23:44:10.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:10 gibba001 conmon[29242]: audit 2021-02-10T23:44:10.618429+0000 mon.a (mon.0) 210 : audit [DBG] from='client.? 172.21.2.101:0/3558715204' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-02-10T23:44:11.186 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-02-10T23:44:11.342 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:11.804 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:11 gibba001 conmon[29242]: cluster 2021-02-10T23:44:11.259484+0000 mgr.x (mgr.14140) 49 : cluster [DBG] pgmap v47: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:13.259 INFO:teuthology.orchestra.run.gibba001.stdout:34359738379 2021-02-10T23:44:13.260 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-02-10T23:44:13.409 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:14.704 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:14 gibba001 conmon[29242]: cluster 2021-02-10T23:44:13.259704+0000 mgr.x (mgr.14140) 50 : cluster [DBG] pgmap v48: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:15.586 INFO:teuthology.orchestra.run.gibba001.stdout:55834574855 2021-02-10T23:44:15.587 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-02-10T23:44:15.733 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:16.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:16 gibba001 conmon[29242]: cluster 2021-02-10T23:44:15.259990+0000 mgr.x (mgr.14140) 51 : cluster [DBG] pgmap v49: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:17.226 INFO:teuthology.orchestra.run.gibba001.stdout:34359738379 2021-02-10T23:44:17.845 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738379 got 34359738379 for osd.0 2021-02-10T23:44:17.845 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-02-10T23:44:17.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:17 gibba001 conmon[29242]: audit 2021-02-10T23:44:17.227880+0000 mon.a (mon.0) 211 : audit [DBG] from='client.? 172.21.2.101:0/1141943379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-02-10T23:44:17.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:17 gibba001 conmon[29242]: cluster 2021-02-10T23:44:17.260393+0000 mgr.x (mgr.14140) 52 : cluster [DBG] pgmap v50: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:17.998 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:19.477 INFO:teuthology.orchestra.run.gibba001.stdout:55834574855 2021-02-10T23:44:20.134 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.1 2021-02-10T23:44:20.135 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-02-10T23:44:20.135 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:20.282 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:20.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:20 gibba001 conmon[29242]: cluster 2021-02-10T23:44:19.260574+0000 mgr.x (mgr.14140) 53 : cluster [DBG] pgmap v51: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:20.659 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:20 gibba001 conmon[29242]: audit 2021-02-10T23:44:19.479043+0000 mon.a (mon.0) 212 : audit [DBG] from='client.? 172.21.2.101:0/1022155364' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-02-10T23:44:21.825 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:21.826 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:22.436 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":52,"stamp":"2021-02-10T23:44:21.261056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738380,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40899999999999997}]}]}]}} 2021-02-10T23:44:22.437 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:22.585 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:22.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:22 gibba001 conmon[29242]: cluster 2021-02-10T23:44:21.261185+0000 mgr.x (mgr.14140) 54 : cluster [DBG] pgmap v52: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:23.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:23 gibba001 conmon[29242]: audit 2021-02-10T23:44:21.825860+0000 mgr.x (mgr.14140) 55 : audit [DBG] from='client.14210 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:24.065 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:24.067 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:24.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:24 gibba001 conmon[29242]: cluster 2021-02-10T23:44:23.261371+0000 mgr.x (mgr.14140) 56 : cluster [DBG] pgmap v53: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:24.719 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2021-02-10T23:44:23.261291+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]}]}} 2021-02-10T23:44:24.720 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:44:24.870 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:25.358 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:25 gibba001 conmon[29242]: audit 2021-02-10T23:44:24.066807+0000 mgr.x (mgr.14140) 57 : audit [DBG] from='client.14212 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:26.416 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:26.416 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":124,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":2,"modified":"2021-02-10T23:43:55.256875+0000","services":{"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:44:26.631 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:26 gibba001 conmon[29242]: cluster 2021-02-10T23:44:25.261596+0000 mgr.x (mgr.14140) 58 : cluster [DBG] pgmap v54: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:27.046 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:44:27.046 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:27.220 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:27.684 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:27 gibba001 conmon[29242]: audit 2021-02-10T23:44:26.417635+0000 mon.a (mon.0) 213 : audit [DBG] from='client.? 172.21.2.101:0/3340029435' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:44:28.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:28 gibba001 conmon[29242]: cluster 2021-02-10T23:44:27.261842+0000 mgr.x (mgr.14140) 59 : cluster [DBG] pgmap v55: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:28.759 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:28.760 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:29.361 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2021-02-10T23:44:27.261758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":8,"seq":34359738381,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]}]}]}} 2021-02-10T23:44:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:30 gibba001 conmon[29242]: audit 2021-02-10T23:44:28.760466+0000 mgr.x (mgr.14140) 60 : audit [DBG] from='client.14216 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:30 gibba001 conmon[29242]: cluster 2021-02-10T23:44:29.262577+0000 mgr.x (mgr.14140) 61 : cluster [DBG] pgmap v56: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:32.363 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:32.508 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:32.696 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:32 gibba001 conmon[29242]: cluster 2021-02-10T23:44:31.263003+0000 mgr.x (mgr.14140) 62 : cluster [DBG] pgmap v57: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:34.001 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:34.002 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:34.601 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:34 gibba001 conmon[29242]: cluster 2021-02-10T23:44:33.263401+0000 mgr.x (mgr.14140) 63 : cluster [DBG] pgmap v58: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:34.610 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2021-02-10T23:44:33.263306+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]}]}} 2021-02-10T23:44:34.611 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:44:34.759 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:35.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:35 gibba001 conmon[29242]: audit 2021-02-10T23:44:34.002418+0000 mgr.x (mgr.14140) 64 : audit [DBG] from='client.14218 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:36.042 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:35 gibba001 conmon[29242]: 2021-02-10T23:44:36.385 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:36.385 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":134,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":3,"modified":"2021-02-10T23:44:33.263337+0000","services":{"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:44:36.597 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:36 gibba001 conmon[29242]: cluster 2021-02-10T23:44:35.263662+0000 mgr.x (mgr.14140) 65 : cluster [DBG] pgmap v59: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:36.983 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:44:36.983 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:37.129 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:37.597 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:37 gibba001 conmon[29242]: audit 2021-02-10T23:44:36.386838+0000 mon.a (mon.0) 214 : audit [DBG] from='client.? 172.21.2.101:0/3603616760' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:44:37.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:37 gibba001 conmon[29242]: 2021-02-10T23:44:38.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:38 gibba001 conmon[29242]: cluster 2021-02-10T23:44:37.264022+0000 mgr.x (mgr.14140) 66 : cluster [DBG] pgmap v60: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:38.647 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:38.648 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:39.257 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2021-02-10T23:44:37.263946+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738383,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]}]}} 2021-02-10T23:44:40.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:40 gibba001 conmon[29242]: audit 2021-02-10T23:44:38.648397+0000 mgr.x (mgr.14140) 67 : audit [DBG] from='client.14222 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:40.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:40 gibba001 conmon[29242]: cluster 2021-02-10T23:44:39.264426+0000 mgr.x (mgr.14140) 68 : cluster [DBG] pgmap v61: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:42.259 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:42.683 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:42.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:42 gibba001 conmon[29242]: cluster 2021-02-10T23:44:41.264668+0000 mgr.x (mgr.14140) 69 : cluster [DBG] pgmap v62: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:44.225 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:44.226 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:44.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:44 gibba001 conmon[29242]: cluster 2021-02-10T23:44:43.264938+0000 mgr.x (mgr.14140) 70 : cluster [DBG] pgmap v63: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:44.822 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":63,"stamp":"2021-02-10T23:44:43.264827+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574860,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}]}} 2021-02-10T23:44:44.823 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:44:44.970 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:45.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:45 gibba001 conmon[29242]: audit 2021-02-10T23:44:44.226122+0000 mgr.x (mgr.14140) 71 : audit [DBG] from='client.14224 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:46.502 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:46.502 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":144,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":3,"modified":"2021-02-10T23:44:33.263337+0000","services":{"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:44:46.689 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:46 gibba001 conmon[29242]: cluster 2021-02-10T23:44:45.265184+0000 mgr.x (mgr.14140) 72 : cluster [DBG] pgmap v64: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:47.082 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:44:47.083 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:47.228 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:47.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:47 gibba001 conmon[29242]: audit 2021-02-10T23:44:46.503343+0000 mon.a (mon.0) 215 : audit [DBG] from='client.? 172.21.2.101:0/1460669615' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:44:48.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:48 gibba001 conmon[29242]: cluster 2021-02-10T23:44:47.265381+0000 mgr.x (mgr.14140) 73 : cluster [DBG] pgmap v65: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:48.749 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:48.751 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:49.278 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2021-02-10T23:44:47.265300+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738385,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53000000000000003}]}]}]}} 2021-02-10T23:44:50.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:50 gibba001 conmon[29242]: audit 2021-02-10T23:44:48.750896+0000 mgr.x (mgr.14140) 74 : audit [DBG] from='client.14228 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:50 gibba001 conmon[29242]: cluster 2021-02-10T23:44:49.265816+0000 mgr.x (mgr.14140) 75 : cluster [DBG] pgmap v66: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:52.280 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:52.432 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:52.603 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:52 gibba001 conmon[29242]: cluster 2021-02-10T23:44:51.266551+0000 mgr.x (mgr.14140) 76 : cluster [DBG] pgmap v67: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:53.636 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:44:53 gibba001 conmon[29628]: debug 2021-02-10T23:44:53.256+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:44:53.892 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:53.893 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:54.468 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":68,"stamp":"2021-02-10T23:44:53.267000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574862,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]}]}]}} 2021-02-10T23:44:54.469 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:44:54.615 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:54.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:54 gibba001 conmon[29242]: cluster 2021-02-10T23:44:53.267084+0000 mgr.x (mgr.14140) 77 : cluster [DBG] pgmap v68: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:54.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:54 gibba001 conmon[29242]: audit 2021-02-10T23:44:53.353614+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:44:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:54 gibba001 conmon[29242]: audit 2021-02-10T23:44:53.354450+0000 2021-02-10T23:44:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:54 gibba001 conmon[29242]: mon.a (mon.0) 217 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:44:55.684 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:55 gibba001 conmon[29242]: audit 2021-02-10T23:44:53.893235+0000 mgr.x (mgr.14140) 78 : audit [DBG] from='client.14230 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:44:56.153 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:56.153 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":154,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:44:56.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:56 gibba001 conmon[29242]: cluster 2021-02-10T23:44:55.267338+0000 mgr.x (mgr.14140) 79 : cluster [DBG] pgmap v69: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:56.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:56 gibba001 conmon[29242]: audit 2021-02-10T23:44:56.154328+0000 mon.a (mon.0) 218 : audit [DBG] from='client.? 172.21.2.101:0/2296956924' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:44:56.749 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:44:56.749 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:44:56.896 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:44:57.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:57 gibba001 conmon[29242]: cluster 2021-02-10T23:44:57.267549+0000 mgr.x (mgr.14140) 80 : cluster [DBG] pgmap v70: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:44:58.449 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:44:58.450 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:44:59.011 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":70,"stamp":"2021-02-10T23:44:57.267477+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574863,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.47799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738387,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]}]}]}} 2021-02-10T23:44:59.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:44:59 gibba001 conmon[29242]: cluster 2021-02-10T23:44:59.319236+0000 mon.a (mon.0) 219 : cluster [WRN] Health check failed: Degraded data redundancy: 8 pgs undersized (PG_DEGRADED) 2021-02-10T23:45:00.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:00 gibba001 conmon[29242]: audit 2021-02-10T23:44:58.450018+0000 mgr.x (mgr.14140) 81 : audit [DBG] from='client.14234 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:00.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:00 gibba001 conmon[29242]: cluster 2021-02-10T23:44:59.268222+0000 mgr.x (mgr.14140) 82 : cluster [DBG] pgmap v71: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:02.013 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:02.161 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:02.668 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:02 gibba001 conmon[29242]: cluster 2021-02-10T23:45:01.268941+0000 mgr.x (mgr.14140) 83 : cluster [DBG] pgmap v72: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:03.689 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:03.690 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:04.302 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":73,"stamp":"2021-02-10T23:45:03.269113+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.39500000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41199999999999998}]}]}]}} 2021-02-10T23:45:04.303 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:04.452 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:05.000 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:04 gibba001 conmon[29242]: cluster 2021-02-10T23:45:03.269309+0000 mgr.x (mgr.14140) 84 : cluster [DBG] pgmap v73: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:05.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:05 gibba001 conmon[29242]: audit 2021-02-10T23:45:03.690082+0000 mgr.x (mgr.14140) 85 : audit [DBG] from='client.14236 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:06.033 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:06.034 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":164,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:06.625 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:06.625 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:06.642 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:06 gibba001 conmon[29242]: cluster 2021-02-10T23:45:05.269908+0000 mgr.x (mgr.14140) 86 : cluster [DBG] pgmap v74: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:06.642 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:06 gibba001 conmon[29242]: audit 2021-02-10T23:45: 2021-02-10T23:45:06.642 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:06 gibba001 conmon[29242]: 06.035714+0000 mon.a (mon.0) 220 : audit [DBG] from='client.? 172.21.2.101:0/3395420187' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:06.774 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:07.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:07 gibba001 conmon[29242]: cluster 2021-02-10T23:45:07.270363+0000 mgr.x (mgr.14140) 87 : cluster [DBG] pgmap v75: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:08.242 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:08.243 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:08.828 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":75,"stamp":"2021-02-10T23:45:07.270242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.57199999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738389,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41199999999999998}]}]}]}} 2021-02-10T23:45:08.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:08 gibba001 conmon[29242]: audit 2021-02-10T23:45:08.243531+0000 mgr.x (mgr.14140) 88 : audit [DBG] from='client.14240 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:09.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:09 gibba001 conmon[29242]: cluster 2021-02-10T23:45:09.271182+0000 mgr.x (mgr.14140) 89 : cluster [DBG] pgmap v76: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:11.830 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:11.977 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:12.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:12 gibba001 conmon[29242]: cluster 2021-02-10T23:45:11.271883+0000 mgr.x (mgr.14140) 90 : cluster [DBG] pgmap v77: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:12.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:12 gibba001 conmon[29242]: 2021-02-10T23:45:13.467 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:13.469 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:14.078 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":78,"stamp":"2021-02-10T23:45:13.272163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574866,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.39600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46200000000000002}]}]}]}} 2021-02-10T23:45:14.079 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:14.225 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:14.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:14 gibba001 conmon[29242]: cluster 2021-02-10T23:45:13.272283+0000 mgr.x (mgr.14140) 91 : cluster [DBG] pgmap v78: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:15.554 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:15 gibba001 conmon[29242]: audit 2021-02-10T23:45:13.468770+0000 mgr.x (mgr.14140) 92 : audit [DBG] from='client.14242 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:15.554 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:15 gibba001 conmon[29242]: 2021-02-10T23:45:15.809 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:15.810 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":174,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:16.397 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:16.397 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:16.541 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:16 gibba001 conmon[29242]: cluster 2021-02-10T23:45:15.272629+0000 mgr.x (mgr.14140) 93 : cluster [DBG] pgmap v79: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:16 gibba001 conmon[29242]: audit 2021-02-10T23:45:15.810731+0000 mon.a (mon.0) 221 : audit [DBG] from='client.? 172.21.2.101:0/731680252' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:17.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:17 gibba001 conmon[29242]: cluster 2021-02-10T23:45:17.273256+0000 mgr.x (mgr.14140) 94 : cluster [DBG] 2021-02-10T23:45:17.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:17 gibba001 conmon[29242]: pgmap v80: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:17.975 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:17.976 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:18.607 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":80,"stamp":"2021-02-10T23:45:17.273145+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574867,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738391,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46200000000000002}]}]}]}} 2021-02-10T23:45:18.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:18 gibba001 conmon[29242]: audit 2021-02-10T23:45:17.976431+0000 mgr.x (mgr.14140) 95 : audit [DBG] from='client.14246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:19.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:19 gibba001 conmon[29242]: cluster 2021-02-10T23:45:19.273946+0000 mgr.x (mgr.14140) 96 : cluster [DBG] pgmap v81: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:19.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:19 gibba001 conmon[29242]: 2021-02-10T23:45:21.608 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:21.756 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:22.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:22 gibba001 conmon[29242]: cluster 2021-02-10T23:45:21.274679+0000 mgr.x (mgr.14140) 97 : cluster [DBG] pgmap v82: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:23.241 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:23.242 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:23.803 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":82,"stamp":"2021-02-10T23:45:21.274532+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574868,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.47299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738392,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.28699999999999998}]}]}]}} 2021-02-10T23:45:23.804 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:23.951 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:24.433 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:24 gibba001 conmon[29242]: audit 2021-02-10T23:45:23.242267+0000 mgr.x (mgr.14140) 98 : audit [DBG] 2021-02-10T23:45:24.433 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:24 gibba001 conmon[29242]: from='client.14248 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:24.433 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:24 gibba001 conmon[29242]: cluster 2021-02-10T23:45:23.275053+0000 mgr.x (mgr.14140) 99 : cluster [DBG] pgmap v83: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:25.510 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:25.510 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":183,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:26.073 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:26.073 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:26.219 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:26.673 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:26 gibba001 conmon[29242]: cluster 2021-02-10T23:45:25.275335+0000 mgr.x (mgr.14140) 100 : cluster [DBG] pgmap v84: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:26.673 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:26 gibba001 conmon[29242]: audit 2021-02-10T23:45:25.511960+0000 mon.a (mon.0) 222 : audit [DBG] from='client.? 172.21.2.101:0/3580645781' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:27.650 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:27.650 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:27.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:27 gibba001 conmon[29242]: cluster 2021-02-10T23:45:27.275840+0000 mgr.x (mgr.14140) 101 : cluster [DBG] pgmap v85: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:28.344 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2021-02-10T23:45:27.275554+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574869,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738393,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.312},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34699999999999998}]}]}]}} 2021-02-10T23:45:28.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:28 gibba001 conmon[29242]: audit 2021-02-10T23:45:27.649631+0000 mgr.x (mgr.14140) 102 : audit [DBG] from='client.14252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:29.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:29 gibba001 conmon[29242]: cluster 2021-02-10T23:45:29.276580+0000 mgr.x (mgr.14140) 103 : cluster [DBG] pgmap v86: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:31.346 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:31.490 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:32.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:32 gibba001 conmon[29242]: cluster 2021-02-10T23:45:31.277073+0000 mgr.x (mgr.14140) 104 : cluster [DBG] pgmap v87: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:32.999 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:33.000 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:33.586 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":87,"stamp":"2021-02-10T23:45:31.276858+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574870,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738394,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.52400000000000002}]}]}]}} 2021-02-10T23:45:33.587 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:33.733 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:34 gibba001 conmon[29242]: audit 2021-02-10T23:45:33.000052+0000 mgr.x (mgr.14140) 105 : audit [DBG] from='client.14254 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:34 gibba001 conmon[29242]: cluster 2021-02-10T23:45:33.277448+0000 mgr.x (mgr.14140) 106 : cluster [DBG] pgmap v88: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:35.281 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:35.282 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":193,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:35.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:35 gibba001 conmon[29242]: audit 2021-02-10T23:45:35.283246+0000 mon.a (mon.0) 223 : audit [DBG] 2021-02-10T23:45:35.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:35 gibba001 conmon[29242]: from='client.? 172.21.2.101:0/1123412753' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:35.877 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:35.877 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:36.023 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:36.507 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:36 gibba001 conmon[29242]: cluster 2021-02-10T23:45:35.277698+0000 mgr.x (mgr.14140) 107 : cluster [DBG] pgmap v89: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:37.610 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:37.611 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:37.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:37 gibba001 conmon[29242]: cluster 2021-02-10T23:45:37.278245+0000 mgr.x (mgr.14140) 108 : cluster [DBG] pgmap v90: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:38.254 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-02-10T23:45:37.278136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.42899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738395,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45900000000000002}]}]}]}} 2021-02-10T23:45:38.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:38 gibba001 conmon[29242]: audit 2021-02-10T23:45:37.611091+0000 mgr.x (mgr.14140) 109 : audit [DBG] from='client.14258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:39.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:39 gibba001 conmon[29242]: cluster 2021-02-10T23:45:39.279109+0000 mgr.x (mgr.14140) 110 : cluster [DBG] pgmap v91: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:41.256 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:41.406 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:42.629 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:42 gibba001 conmon[29242]: cluster 2021-02-10T23:45:41.279407+0000 mgr.x (mgr.14140) 111 : cluster [DBG] pgmap v92: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:42.882 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:42.884 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:43.484 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":92,"stamp":"2021-02-10T23:45:41.279240+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.318},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.433}]}]},{"osd":0,"up_from":8,"seq":34359738396,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.443}]}]}]}} 2021-02-10T23:45:43.484 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:43.630 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:44.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:44 gibba001 conmon[29242]: audit 2021-02-10T23:45:42.883703+0000 mgr.x (mgr.14140) 112 : audit [DBG] from='client.14260 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:44.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:44 gibba001 conmon[29242]: cluster 2021-02-10T23:45:43.279874+0000 mgr.x (mgr.14140) 113 : cluster [DBG] pgmap v93: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:45.134 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:45.144 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":203,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:45.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:45 gibba001 conmon[29242]: audit 2021-02-10T23:45:45.135846+0000 mon.a (mon.0) 224 : audit [DBG] from='client.? 172.21.2.101:0/4233415021' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:45.728 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:45.728 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:45.874 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:46.368 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:46 gibba001 conmon[29242]: cluster 2021-02-10T23:45:45.280284+0000 mgr.x (mgr.14140) 114 : cluster [DBG] pgmap v94: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:47.393 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:47.394 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:47.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:47 gibba001 conmon[29242]: cluster 2021-02-10T23:45:47.280510+0000 mgr.x (mgr.14140) 115 : cluster [DBG] pgmap v95: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:47.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:47 gibba001 conmon[29242]: audit 2021-02-10T23:45:47.394315+0000 mgr.x (mgr.14140) 116 : audit [DBG] from='client.14264 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:47.986 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2021-02-10T23:45:47.280400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574873,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.55500000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738397,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.54700000000000004}]}]}]}} 2021-02-10T23:45:50.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:50 gibba001 conmon[29242]: cluster 2021-02-10T23:45:49.281164+0000 mgr.x (mgr.14140) 117 : cluster [DBG] pgmap v96: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:50.988 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:51.135 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:52.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:52 gibba001 conmon[29242]: cluster 2021-02-10T23:45:51.281441+0000 mgr.x (mgr.14140) 118 : cluster [DBG] pgmap v97: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:52.617 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:52.618 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:53.257 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":97,"stamp":"2021-02-10T23:45:51.281324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738398,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39500000000000002}]}]}]}} 2021-02-10T23:45:53.259 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:45:53.406 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:53.629 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:45:53 gibba001 conmon[29628]: debug 2021-02-10T23:45:53.256+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:45:54.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:54 gibba001 conmon[29242]: audit 2021-02-10T23:45:52.618160+0000 mgr.x (mgr.14140) 119 : audit [DBG] from='client.14266 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:54.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:54 gibba001 conmon[29242]: cluster 2021-02-10T23:45:53.281660+0000 mgr.x (mgr.14140) 120 : cluster [DBG] pgmap v98: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:54.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:54 gibba001 conmon[29242]: audit 2021-02-10T23:45:53.356374+0000 mon.a (mon.0) 225 : audit [INF] 2021-02-10T23:45:54.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:54 gibba001 conmon[29242]: from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:45:54.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:54 gibba001 conmon[29242]: audit 2021-02-10T23:45:53.356491+0000 mon.a (mon.0) 226 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:45:54.966 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:54.967 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":213,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:45:55.587 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:45:55.587 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:45:55.604 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:55 gibba001 conmon[29242]: audit 2021-02-10T23:45:54.968714+0000 mon.a (mon.0) 227 : audit [DBG] from='client.? 172.21.2.101:0/2215473128' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:45:55.735 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:45:56.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:56 gibba001 conmon[29242]: cluster 2021-02-10T23:45:55.282169+0000 mgr.x (mgr.14140) 121 : cluster [DBG] pgmap v99: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:45:57.190 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:45:57.191 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:45:57.766 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":99,"stamp":"2021-02-10T23:45:55.282028+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574875,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:44:49 2021","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.45400000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.51500000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738399,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:44:52 2021","interfaces":[{"interface":"back","average":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.66100000000000003,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.503}]}]}]}} 2021-02-10T23:45:57.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:57 gibba001 conmon[29242]: audit 2021-02-10T23:45:57.190916+0000 mgr.x (mgr.14140) 122 : audit [DBG] from='client.14270 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:45:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:57 gibba001 conmon[29242]: cluster 2021-02-10T23:45:57.282401+0000 mgr.x ( 2021-02-10T23:45:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:45:57 gibba001 conmon[29242]: mgr.14140) 123 : cluster [DBG] pgmap v100: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:00.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:00 gibba001 conmon[29242]: cluster 2021-02-10T23:45:59.283131+0000 mgr.x (mgr.14140) 124 : cluster [DBG] pgmap v101: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:00.767 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:00.913 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:02.459 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:02.461 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:02.631 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:02 gibba001 conmon[29242]: cluster 2021-02-10T23:46:01.283417+0000 mgr.x (mgr.14140) 125 : cluster [DBG] pgmap v102: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:02.998 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":102,"stamp":"2021-02-10T23:46:01.283296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574876,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.40799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738400,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42699999999999999}]}]}]}} 2021-02-10T23:46:02.999 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:03.146 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:04.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:04 gibba001 conmon[29242]: audit 2021-02-10T23:46:02.460775+0000 mgr.x (mgr.14140) 126 : audit [DBG] from='client.14272 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:04.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:04 gibba001 conmon[29242]: cluster 2021-02-10T23:46:03.283822+0000 mgr.x (mgr.14140) 127 : cluster [DBG] pgmap v103: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:04.692 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:04.692 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":223,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:05.300 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:05.300 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:05.448 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:05.678 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:05 gibba001 conmon[29242]: audit 2021-02-10T23:46:04.693861+0000 mon.a (mon.0) 228 : audit [DBG] from='client.? 172.21.2.101:0/123286824' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:06.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:06 gibba001 conmon[29242]: cluster 2021-02-10T23:46:05.284092+0000 mgr.x (mgr.14140) 128 : cluster [DBG] pgmap v104: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:06.966 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:06.967 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:07.516 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":104,"stamp":"2021-02-10T23:46:05.283970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574877,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.40699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738401,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34999999999999998}]}]}]}} 2021-02-10T23:46:07.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:07 gibba001 conmon[29242]: audit 2021-02-10T23:46:06.967440+0000 mgr.x (mgr.14140) 129 : audit [DBG] from='client.14276 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:07.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:07 gibba001 conmon[29242]: cluster 2021-02-10T23:46:07.284423+0000 mgr.x (mgr.14140) 130 : cluster [DBG] pgmap v105: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:10.518 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:10.667 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:10.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:10 gibba001 conmon[29242]: cluster 2021-02-10T23:46:09.284884+0000 mgr.x (mgr.14140) 131 : cluster [DBG] pgmap v106: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:12.159 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:12.160 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:12.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:12 gibba001 conmon[29242]: cluster 2021-02-10T23:46:11.285438+0000 mgr.x (mgr.14140) 132 : cluster [DBG] pgmap v107: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:12.771 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":107,"stamp":"2021-02-10T23:46:11.285313+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.50800000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738402,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38300000000000001}]}]}]}} 2021-02-10T23:46:12.772 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:12.918 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:13.428 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:13 gibba001 conmon[29242]: audit 2021-02-10T23:46:12.159870+0000 mgr.x (mgr.14140) 133 : audit [DBG] from='client.14278 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:14.508 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:14.508 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":232,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:14.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:14 gibba001 conmon[29242]: cluster 2021-02-10T23:46:13.285824+0000 mgr.x (mgr.14140) 134 : cluster [DBG] pgmap v108: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:15.131 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:15.132 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:15.279 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:15.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:15 gibba001 conmon[29242]: audit 2021-02-10T23:46:14.510138+0000 mon.a (mon.0) 229 : audit [DBG] from='client.? 172.21.2.101:0/3901180504' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:16.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:16 gibba001 conmon[29242]: cluster 2021-02-10T23:46:15.286111+0000 mgr.x (mgr.14140) 135 : cluster [DBG] pgmap v109: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:16.775 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:16.776 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:17.348 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":109,"stamp":"2021-02-10T23:46:15.285978+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359738403,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.436}]}]}]}} 2021-02-10T23:46:17.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:17 gibba001 conmon[29242]: audit 2021-02-10T23:46:16.776560+0000 mgr.x (mgr.14140) 136 : audit [DBG] from='client.14282 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:17.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:17 gibba001 conmon[29242]: cluster 2021-02-10T23:46:17.286730+0000 mgr.x (mgr.14140) 137 : cluster [DBG] pgmap v110: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:20.349 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:20.498 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:20.678 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:20 gibba001 conmon[29242]: cluster 2021-02-10T23:46:19.287486+0000 mgr.x (mgr.14140) 138 : cluster [DBG] pgmap v111: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:22.010 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:22.011 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:22.593 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:22 gibba001 conmon[29242]: cluster 2021-02-10T23:46:21.287926+0000 mgr.x (mgr.14140) 139 : cluster [DBG] pgmap v112: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:22.606 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":112,"stamp":"2021-02-10T23:46:21.287791+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574880,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.42599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738404,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.34000000000000002}]}]}]}} 2021-02-10T23:46:22.607 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:22.755 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:23.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:23 gibba001 conmon[29242]: audit 2021-02-10T23:46:22.010695+0000 mgr.x (mgr.14140) 140 : audit [DBG] from='client.14284 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:24.324 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:24.324 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":242,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:24.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:24 gibba001 conmon[29242]: cluster 2021-02-10T23:46:23.288182+0000 mgr.x (mgr.14140) 141 : cluster [DBG] pgmap v113: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:24.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:24 gibba001 conmon[29242]: audit 2021-02-10T23:46:24.326185+0000 mon.a (mon.0) 230 : audit [DBG] from='client.? 172.21.2.101:0/617769976' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:24.958 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:24.958 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:25.102 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:26.656 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:26.657 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:26.672 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:26 gibba001 conmon[29242]: cluster 2021-02-10T23:46:25.288829+0000 mgr.x (mgr.14140) 142 : 2021-02-10T23:46:26.672 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:26 gibba001 conmon[29242]: cluster [DBG] pgmap v114: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:27.203 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":114,"stamp":"2021-02-10T23:46:25.288705+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.43099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738405,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46800000000000003}]}]}]}} 2021-02-10T23:46:27.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:27 gibba001 conmon[29242]: audit 2021-02-10T23:46:26.657176+0000 mgr.x (mgr.14140) 143 : audit [DBG] from='client.14288 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:27.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:27 gibba001 conmon[29242]: cluster 2021-02-10T23:46:27.289244+0000 mgr.x (mgr.14140) 144 : cluster [DBG] pgmap v115: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:30.205 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:30.357 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:30.596 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:30 gibba001 conmon[29242]: cluster 2021-02-10T23:46:29.290108+0000 mgr.x (mgr.14140) 145 : cluster [DBG] pgmap v116: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:31.875 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:31.877 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:32.456 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":117,"stamp":"2021-02-10T23:46:31.290339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.43099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40100000000000002}]}]}]}} 2021-02-10T23:46:32.457 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:32.605 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:32.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:32 gibba001 conmon[29242]: cluster 2021-02-10T23:46:31.290474+0000 mgr.x (mgr.14140) 146 : cluster [DBG] pgmap v117: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:33.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:33 gibba001 conmon[29242]: audit 2021-02-10T23:46:31.876707+0000 mgr.x (mgr.14140) 147 : audit [DBG] from='client.14290 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:34.166 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:34.166 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":252,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:34.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:34 gibba001 conmon[29242]: cluster 2021-02-10T23:46:33.290891+0000 mgr.x (mgr.14140) 148 : cluster [DBG] pgmap v118: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:34.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:34 gibba001 conmon[29242]: audit 2021-02-10T23:46:34.168225+0000 mon.a (mon.0) 231 : audit [DBG] from='client.? 172.21.2.101:0/150683028' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:34.781 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:34.782 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:34.929 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:36.542 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:36.543 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:36.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:36 gibba001 conmon[29242]: cluster 2021-02-10T23:46:35.291323+0000 mgr.x (mgr.14140) 149 : cluster [DBG] pgmap v119: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:37.153 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":119,"stamp":"2021-02-10T23:46:35.291200+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574883,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42599999999999999}]}]}]}} 2021-02-10T23:46:37.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:37 gibba001 conmon[29242]: audit 2021-02-10T23:46:36.543206+0000 mgr.x (mgr.14140) 150 : audit [DBG] from='client.14294 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:37.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:37 gibba001 conmon[29242]: cluster 2021-02-10T23:46:37.291923+0000 mgr.x (mgr.14140) 151 : cluster [DBG] pgmap v120: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:40.155 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:40.302 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:40.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:40 gibba001 conmon[29242]: cluster 2021-02-10T23:46:39.292419+0000 mgr.x (mgr.14140) 152 : cluster [DBG] pgmap v121: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:41.782 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:41.783 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:42.395 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":122,"stamp":"2021-02-10T23:46:41.292536+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574884,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.47199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.44},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.50800000000000001}]}]}]}} 2021-02-10T23:46:42.396 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:42.545 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:42.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:42 gibba001 conmon[29242]: cluster 2021-02-10T23:46:41.292652+0000 mgr.x (mgr.14140) 153 : cluster [DBG] pgmap v122: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:43.618 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:43 gibba001 conmon[29242]: audit 2021-02-10T23:46:41.783419+0000 mgr.x (mgr.14140) 154 : audit [DBG] from='client.14296 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:44.107 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:44.107 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":262,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:44.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:44 gibba001 conmon[29242]: cluster 2021-02-10T23:46:43.293084+0000 mgr.x (mgr.14140) 155 : cluster [DBG] pgmap v123: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:44.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:44 gibba001 conmon[29242]: audit 2021-02-10T23:46:44.108617+0000 mon.a (mon.0) 232 : audit [DBG] from='client.? 172.21.2.101:0/98465097' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:44.712 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:44.712 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:44.860 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:46.325 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:46.326 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:46.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:46 gibba001 conmon[29242]: cluster 2021-02-10T23:46:45.293303+0000 mgr.x (mgr.14140) 156 : cluster [DBG] pgmap v124: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:46.947 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":124,"stamp":"2021-02-10T23:46:45.293182+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574885,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.48199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738409,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58099999999999996}]}]}]}} 2021-02-10T23:46:47.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:47 gibba001 conmon[29242]: audit 2021-02-10T23:46:46.326273+0000 mgr.x (mgr.14140) 157 : audit [DBG] from='client.14300 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:48.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:48 gibba001 conmon[29242]: cluster 2021-02-10T23:46:47.293699+0000 mgr.x (mgr.14140) 158 : cluster [DBG] pgmap v125: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:49.949 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:50.096 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:50.601 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:50 gibba001 conmon[29242]: cluster 2021-02-10T23:46:49.294373+0000 mgr.x (mgr.14140) 159 : cluster [DBG] pgmap v126: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:51.543 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:51.543 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:52.123 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2021-02-10T23:46:51.294493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574886,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738410,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.439}]}]}]}} 2021-02-10T23:46:52.125 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:46:52.275 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:52.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:52 gibba001 conmon[29242]: cluster 2021-02-10T23:46:51.294624+0000 mgr.x (mgr.14140) 160 : cluster [DBG] pgmap v127: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:53.540 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:46:53 gibba001 conmon[29628]: debug 2021-02-10T23:46:53.258+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:46:53.689 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:53 gibba001 conmon[29242]: audit 2021-02-10T23:46:51.541227+0000 mgr.x (mgr.14140) 161 : audit [DBG] from='client.14302 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:53.791 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:53.791 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":272,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:46:54.375 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:46:54.375 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:54.521 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:46:54.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:54 gibba001 conmon[29242]: cluster 2021-02-10T23:46:53.295174+0000 mgr.x (mgr.14140) 162 : cluster [DBG] pgmap v128: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:54 gibba001 conmon[29242]: audit 2021-02-10T23:46:53.357873+0000 mon.a (mon.0) 233 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:46:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:54 gibba001 conmon[29242]: audit 2021-02-10T23:46:53.358292+0000 2021-02-10T23:46:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:54 gibba001 conmon[29242]: mon.a (mon.0) 234 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:46:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:54 gibba001 conmon[29242]: audit 2021-02-10T23:46:53.792655+0000 mon.a (mon.0) 235 : audit [DBG] from='client.? 172.21.2.101:0/1769443377' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:46:56.100 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:46:56.101 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:46:56.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:56 gibba001 conmon[29242]: cluster 2021-02-10T23:46:55.295446+0000 mgr.x (mgr.14140) 163 : cluster [DBG] pgmap v129: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:56.711 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2021-02-10T23:46:55.295329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574887,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:45:54 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.441,"15min":0.44600000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.57699999999999996,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.45800000000000002,"15min":0.45500000000000002},"min":{"1min":0.36399999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.314}]}]},{"osd":0,"up_from":8,"seq":34359738411,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:45:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.46600000000000003,"15min":0.47599999999999998},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56599999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.46500000000000002,"15min":0.46999999999999997},"min":{"1min":0.28699999999999998,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.54700000000000004,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.50700000000000001}]}]}]}} 2021-02-10T23:46:57.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:57 gibba001 conmon[29242]: audit 2021-02-10T23:46:56.100920+0000 mgr.x (mgr.14140) 164 : audit [DBG] from='client.14306 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:46:58.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:46:58 gibba001 conmon[29242]: cluster 2021-02-10T23:46:57.296106+0000 mgr.x (mgr.14140) 165 : cluster [DBG] pgmap v130: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:46:59.713 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:46:59.859 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:00.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:00 gibba001 conmon[29242]: cluster 2021-02-10T23:46:59.296665+0000 mgr.x (mgr.14140) 166 2021-02-10T23:47:00.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:00 gibba001 conmon[29242]: : cluster [DBG] pgmap v131: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:01.401 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:01.402 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:02.014 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":132,"stamp":"2021-02-10T23:47:01.296779+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574888,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.50600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.432},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35799999999999998}]}]}]}} 2021-02-10T23:47:02.015 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:02.164 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:02.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:02 gibba001 conmon[29242]: cluster 2021-02-10T23:47:01.296931+0000 mgr.x (mgr.14140) 167 : cluster [DBG] pgmap v132: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:02 gibba001 conmon[29242]: audit 2021-02-10T23:47:01.401742+0000 mgr.x (mgr.14140) 168 : audit [DBG] from='client.14308 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:03.868 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:03.868 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":282,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:04.531 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:04.532 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:04.679 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:04 gibba001 conmon[29242]: cluster 2021-02-10T23:47:03.297303+0000 mgr.x (mgr.14140) 169 : cluster [DBG] pgmap v133: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:04 gibba001 conmon[29242]: audit 2021-02-10T23:47:03.870033+0000 mon.a (mon.0) 236 : audit [DBG] from='client.? 172.21.2.101:0/1353257684' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:06.160 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:06.161 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:06.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:06 gibba001 conmon[29242]: cluster 2021-02-10T23:47:05.297613+0000 mgr.x (mgr.14140) 170 : cluster [DBG] pgmap v134: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:06.743 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":134,"stamp":"2021-02-10T23:47:05.297479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.44600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.33800000000000002}]}]}]}} 2021-02-10T23:47:07.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:07 gibba001 conmon[29242]: audit 2021-02-10T23:47:06.160414+0000 mgr.x (mgr.14140) 171 : audit [DBG] from='client.14312 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:08.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:08 gibba001 conmon[29242]: cluster 2021-02-10T23:47:07.298115+0000 mgr.x (mgr.14140) 172 : cluster [DBG] pgmap v135: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:09.744 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:09.892 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:10.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:10 gibba001 conmon[29242]: cluster 2021-02-10T23:47:09.298732+0000 mgr.x (mgr.14140) 173 : cluster [DBG] pgmap v136: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:11.373 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:11.374 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:11.965 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":137,"stamp":"2021-02-10T23:47:11.298869+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574890,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.52400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53200000000000003}]}]}]}} 2021-02-10T23:47:11.966 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:12.111 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:12.616 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:12 gibba001 conmon[29242]: cluster 2021-02-10T23:47:11.298982+0000 mgr.x (mgr.14140) 174 : cluster [DBG] pgmap v137: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:12.616 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:12 gibba001 conmon[29242]: audit 2021-02-10T23:47:11.373992+0000 mgr.x (mgr.14140) 175 : audit [DBG] from='client.14314 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:13.716 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:13.716 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":292,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:14.345 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:14.345 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:14.490 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:14.662 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:14 gibba001 conmon[29242]: cluster 2021-02-10T23:47:13.299245+0000 mgr.x (mgr.14140) 176 : cluster [DBG] pgmap v138: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:14.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:14 gibba001 conmon[29242]: audit 2021-02-10T23:47:13.717648+0000 mon.a (mon.0) 237 : audit [DBG] from='client.? 172.21.2.101:0/3110979010' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:15.966 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:15.967 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:16.589 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":139,"stamp":"2021-02-10T23:47:15.299394+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574891,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.45600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738415,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998}]}]}]}} 2021-02-10T23:47:16.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:16 gibba001 conmon[29242]: cluster 2021-02-10T23:47:15.299511+0000 mgr.x (mgr.14140) 177 : cluster [DBG] pgmap v139: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:17.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:17 gibba001 conmon[29242]: audit 2021-02-10T23:47:15.967304+0000 mgr.x (mgr.14140) 178 : audit [DBG] from='client.14318 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:18.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:18 gibba001 conmon[29242]: cluster 2021-02-10T23:47:17.300017+0000 mgr.x (mgr.14140) 179 : cluster [DBG] pgmap v140: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:19.681 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:19.825 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:20.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:20 gibba001 conmon[29242]: cluster 2021-02-10T23:47:19.300526+0000 mgr.x (mgr.14140) 180 : cluster [DBG] pgmap v141: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:21.382 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:21.383 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:21.970 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":142,"stamp":"2021-02-10T23:47:21.300665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574892,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.51100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738416,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46899999999999997}]}]}]}} 2021-02-10T23:47:21.971 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:22.116 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:22.633 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:22 gibba001 conmon[29242]: cluster 2021-02-10T23:47:21.300779+0000 mgr.x (mgr.14140) 181 : cluster [DBG] pgmap v142: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:22.633 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:22 gibba001 conmon[29242]: audit 2021-02-10T23:47:21.383505+0000 mgr.x (mgr.14140) 182 : audit [DBG] from='client.14320 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:23.684 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:23.684 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":302,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:24.299 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:24.300 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:24.447 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:24.619 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:24 gibba001 conmon[29242]: cluster 2021-02-10T23:47:23.301175+0000 mgr.x (mgr.14140) 183 : cluster [DBG] pgmap v143: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:24.619 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:24 gibba001 conmon[29242]: audit 2021-02-10T23:47:23.686417+0000 mon.a (mon.0) 238 : audit [DBG] from='client.? 172.21.2.101:0/1893975078' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:25.916 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:25.917 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:26.596 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2021-02-10T23:47:25.301693+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738417,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45100000000000001}]}]}]}} 2021-02-10T23:47:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:26 gibba001 conmon[29242]: cluster 2021-02-10T23:47:25.301812+0000 mgr.x (mgr.14140) 184 : cluster [DBG] pgmap v144: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:27 gibba001 conmon[29242]: audit 2021-02-10T23:47:25.917159+0000 mgr.x (mgr.14140) 185 : audit [DBG] from='client.14324 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:28.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:28 gibba001 conmon[29242]: cluster 2021-02-10T23:47:27.302443+0000 mgr.x (mgr.14140) 186 : cluster [DBG] pgmap v145: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:29.598 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:29.744 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:30 gibba001 conmon[29242]: cluster 2021-02-10T23:47:29.303168+0000 mgr.x (mgr.14140) 187 : cluster [DBG] pgmap v146: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:31.283 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:31.284 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:31.898 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":146,"stamp":"2021-02-10T23:47:29.303042+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574893,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46400000000000002}]}]}]}} 2021-02-10T23:47:31.899 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:32.046 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:32.571 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:32 gibba001 conmon[29242]: audit 2021-02-10T23:47:31.283702+0000 mgr.x (mgr.14140) 188 : audit [DBG] from='client.14326 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:32.571 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:32 gibba001 conmon[29242]: cluster 2021-02-10T23:47:31.303441+0000 mgr.x (mgr.14140) 189 : cluster [DBG] pgmap v147: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:33.592 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:33.593 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":311,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:34.174 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:34.174 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:34.320 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:34.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:34 gibba001 conmon[29242]: cluster 2021-02-10T23:47:33.303701+0000 mgr.x (mgr.14140) 190 : cluster [DBG] pgmap v148: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:34.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:34 gibba001 conmon[29242]: audit 2021-02-10T23:47:33.594563+0000 mon.a (mon.0) 239 : audit [DBG] from='client.? 172.21.2.101:0/713704225' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:35.940 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:35.941 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:36.539 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2021-02-10T23:47:35.304087+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738419,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45400000000000001}]}]}]}} 2021-02-10T23:47:36.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:36 gibba001 conmon[29242]: cluster 2021-02-10T23:47:35.304245+0000 mgr.x (mgr.14140) 191 : cluster [DBG] pgmap v149: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:37.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:37 gibba001 conmon[29242]: audit 2021-02-10T23:47:35.941069+0000 mgr.x (mgr.14140) 192 : audit [DBG] from='client.14330 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:38.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:38 gibba001 conmon[29242]: cluster 2021-02-10T23:47:37.304803+0000 mgr.x (mgr.14140) 193 : cluster [DBG] pgmap v150: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:39.541 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:39.687 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:40.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:40 gibba001 conmon[29242]: cluster 2021-02-10T23:47:39.305500+0000 mgr.x (mgr.14140) 194 : cluster [DBG] pgmap v151: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:41.217 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:41.219 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:41.846 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2021-02-10T23:47:39.305329+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574895,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738420,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]}]}]}} 2021-02-10T23:47:41.848 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:41.998 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:42.513 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:42 gibba001 conmon[29242]: audit 2021-02-10T23:47:41.218548+0000 mgr.x (mgr.14140) 195 : audit [DBG] from='client.14332 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:42.514 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:42 gibba001 conmon[29242]: cluster 2021-02-10T23:47:41.305890+0000 mgr.x (mgr.14140) 196 : cluster [DBG] pgmap v152: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:43.593 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:43.593 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":321,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:44.271 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:44.271 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:44.417 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:44.629 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:44 gibba001 conmon[29242]: cluster 2021-02-10T23:47:43.306280+0000 mgr.x (mgr.14140) 197 : cluster [DBG] pgmap v153: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:44.629 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:44 gibba001 conmon[29242]: audit 2021-02-10T23:47:43.594680+0000 mon.a (mon.0) 240 : audit [DBG] from='client.? 172.21.2.101:0/3819659454' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:45.966 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:45.967 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:46.558 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2021-02-10T23:47:45.306493+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738421,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.42999999999999999}]}]}]}} 2021-02-10T23:47:46.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:46 gibba001 conmon[29242]: cluster 2021-02-10T23:47:45.306612+0000 mgr.x (mgr.14140) 198 : cluster [DBG] pgmap v154: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:47.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:47 gibba001 conmon[29242]: audit 2021-02-10T23:47:45.967287+0000 mgr.x (mgr.14140) 199 : audit [DBG] from='client.14336 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:48 gibba001 conmon[29242]: cluster 2021-02-10T23:47:47.307183+0000 mgr.x (mgr.14140) 200 : cluster [DBG] pgmap v155: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:49.560 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:49.709 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:50.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:50 gibba001 conmon[29242]: cluster 2021-02-10T23:47:49.307994+0000 mgr.x (mgr.14140) 201 : cluster [DBG] pgmap v156: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:51.233 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:51.234 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:51.814 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2021-02-10T23:47:49.307820+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.30299999999999999}]}]}]}} 2021-02-10T23:47:51.815 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:47:51.967 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:52.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:52 gibba001 conmon[29242]: audit 2021-02-10T23:47:51.234027+0000 mgr.x (mgr.14140) 202 : audit [DBG] from='client.14338 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:52.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:52 gibba001 conmon[29242]: cluster 2021-02-10T23:47:51.308330+0000 mgr.x (mgr.14140) 203 : cluster [DBG] pgmap v157: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:53.415 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:47:53 gibba001 conmon[29628]: debug 2021-02-10T23:47:53.259+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:47:53.577 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:53.577 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":331,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:47:53.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:53 gibba001 conmon[29242]: audit 2021-02-10T23:47:53.359149+0000 mon.a (mon.0) 241 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:47:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:53 gibba001 conmon[29242]: audit 2021-02-10T23:47:53.359411+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:47:54.209 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:47:54.209 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:54.358 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:47:54.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:54 gibba001 conmon[29242]: cluster 2021-02-10T23:47:53.308686+0000 mgr.x (mgr.14140) 204 : cluster [DBG] pgmap v158: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:54.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:54 gibba001 conmon[29242]: audit 2021-02-10T23:47:53.579369+0000 mon.a (mon.0) 243 : audit [DBG] from='client.? 172.21.2.101:0/4069769850' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:47:55.909 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:47:55.910 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:47:56.543 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":159,"stamp":"2021-02-10T23:47:55.309459+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38}]}]},{"osd":0,"up_from":8,"seq":34359738423,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41999999999999998}]}]}]}} 2021-02-10T23:47:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:56 gibba001 conmon[29242]: cluster 2021-02-10T23:47:55.309624+0000 mgr.x (mgr.14140) 205 : cluster [DBG] pgmap v159: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:57.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:57 gibba001 conmon[29242]: audit 2021-02-10T23:47:55.909858+0000 mgr.x (mgr.14140) 206 : audit [DBG] from='client.14342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:47:58.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:47:58 gibba001 conmon[29242]: cluster 2021-02-10T23:47:57.310299+0000 mgr.x (mgr.14140) 207 : cluster [DBG] pgmap v160: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:47:59.546 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:47:59.692 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:00.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:00 gibba001 conmon[29242]: cluster 2021-02-10T23:47:59.310920+0000 mgr.x (mgr.14140) 208 : cluster [DBG] pgmap v161: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:01.174 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:01.175 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:01.754 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":161,"stamp":"2021-02-10T23:47:59.310778+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574899,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:46:56 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.438,"15min":0.44500000000000001},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.57399999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.57899999999999996,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38}]}]},{"osd":0,"up_from":8,"seq":34359738424,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:46:53 2021","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.45100000000000001,"15min":0.47099999999999997},"min":{"1min":0.29599999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.56399999999999995,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45600000000000002,"15min":0.46700000000000003},"min":{"1min":0.33900000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.378}]}]}]}} 2021-02-10T23:48:01.755 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:01.901 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:02.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:02 gibba001 conmon[29242]: audit 2021-02-10T23:48:01.175454+0000 mgr.x (mgr.14140) 209 : audit [DBG] from='client.14344 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:02 gibba001 conmon[29242]: cluster 2021-02-10T23:48:01.311459+0000 mgr.x (mgr.14140) 210 : cluster [DBG] pgmap v162: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:03.461 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:03.461 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":341,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:04.099 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:04.099 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:04.247 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:04.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:04 gibba001 conmon[29242]: cluster 2021-02-10T23:48:03.311697+0000 mgr.x (mgr.14140) 211 : cluster [DBG] pgmap v163: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:04.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:04 gibba001 conmon[29242]: audit 2021-02-10T23:48:03.462564+0000 mon.a (mon.0) 244 : audit [DBG] from='client.? 172.21.2.101:0/2477395912' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:05.807 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:05.808 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:06.459 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":164,"stamp":"2021-02-10T23:48:05.311997+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.501},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.59999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738425,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48699999999999999}]}]}]}} 2021-02-10T23:48:06.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:06 gibba001 conmon[29242]: cluster 2021-02-10T23:48:05.312123+0000 mgr.x (mgr.14140) 212 : cluster [DBG] pgmap v164: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:07.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:07 gibba001 conmon[29242]: audit 2021-02-10T23:48:05.808398+0000 mgr.x (mgr.14140) 213 : audit [DBG] from='client.14348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:08.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:08 gibba001 conmon[29242]: cluster 2021-02-10T23:48:07.312855+0000 mgr.x (mgr.14140) 214 : cluster [DBG] pgmap v165: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:09.460 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:09.607 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:10.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:10 gibba001 conmon[29242]: cluster 2021-02-10T23:48:09.313548+0000 mgr.x (mgr.14140) 215 : cluster [DBG] pgmap v166: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:11.054 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:11.158 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:11.606 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2021-02-10T23:48:09.313402+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574901,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.501},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.59999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39300000000000002}]}]}]}} 2021-02-10T23:48:11.607 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:11.754 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:12 gibba001 conmon[29242]: audit 2021-02-10T23:48:11.050988+0000 mgr.x (mgr.14140) 216 : audit [DBG] from='client.14350 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:12 gibba001 conmon[29242]: cluster 2021-02-10T23:48:11.313937+0000 mgr.x (mgr.14140) 217 : cluster [DBG] pgmap v167: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:13.284 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:13.284 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":351,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:13.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:13 gibba001 conmon[29242]: audit 2021-02-10T23:48:13.286351+0000 mon.a (mon.0) 245 : audit [DBG] from='client.? 172.21.2.101:0/1014728891' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:13.891 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:13.892 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:14.050 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:14.534 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:14 gibba001 conmon[29242]: cluster 2021-02-10T23:48:13.314430+0000 mgr.x (mgr.14140) 218 : cluster [DBG] pgmap v168: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:15.542 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:15.543 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:16.166 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":169,"stamp":"2021-02-10T23:48:15.314571+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738427,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41299999999999998}]}]}]}} 2021-02-10T23:48:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:16 gibba001 conmon[29242]: cluster 2021-02-10T23:48:15.314696+0000 mgr.x (mgr.14140) 219 : cluster [DBG] pgmap v169: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:17.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:17 gibba001 conmon[29242]: audit 2021-02-10T23:48:15.543053+0000 mgr.x (mgr.14140) 220 : audit [DBG] from='client.14354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:18.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:18 gibba001 conmon[29242]: cluster 2021-02-10T23:48:17.315156+0000 mgr.x (mgr.14140) 221 : cluster [DBG] pgmap v170: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:19.168 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:19.313 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:20.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:20 gibba001 conmon[29242]: cluster 2021-02-10T23:48:19.315399+0000 mgr.x (mgr.14140) 222 : cluster [DBG] pgmap v171: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:20.794 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:20.795 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:21.357 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":171,"stamp":"2021-02-10T23:48:19.315285+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574903,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738428,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58099999999999996}]}]}]}} 2021-02-10T23:48:21.358 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:21.505 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:22.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:22 gibba001 conmon[29242]: audit 2021-02-10T23:48:20.795514+0000 mgr.x (mgr.14140) 223 : audit [DBG] from='client.14356 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:22 gibba001 conmon[29242]: cluster 2021-02-10T23:48:21.315821+0000 mgr.x (mgr.14140) 224 : cluster [DBG] pgmap v172: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:23.225 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:23.225 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":361,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:23.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:23 gibba001 conmon[29242]: audit 2021-02-10T23:48:23.227000+0000 mon.a (mon.0) 246 : audit [DBG] from='client.? 172.21.2.101:0/470407397' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:23.832 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:23.833 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:23.979 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:24.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:24 gibba001 conmon[29242]: cluster 2021-02-10T23:48:23.316082+0000 mgr.x (mgr.14140) 225 : cluster [DBG] pgmap v173: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:25.593 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:25.594 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:26.205 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":174,"stamp":"2021-02-10T23:48:25.316311+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.432}]}]},{"osd":0,"up_from":8,"seq":34359738429,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.39300000000000002}]}]}]}} 2021-02-10T23:48:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:26 gibba001 conmon[29242]: cluster 2021-02-10T23:48:25.316434+0000 mgr.x (mgr.14140) 226 : cluster [DBG] pgmap v174: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:27.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:27 gibba001 conmon[29242]: audit 2021-02-10T23:48:25.593989+0000 mgr.x (mgr.14140) 227 : audit [DBG] from='client.14360 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:28.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:28 gibba001 conmon[29242]: cluster 2021-02-10T23:48:27.317155+0000 mgr.x (mgr.14140) 228 : cluster [DBG] pgmap v175: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:29.206 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:29.352 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:30.688 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:30 gibba001 conmon[29242]: cluster 2021-02-10T23:48:29.317416+0000 mgr.x (mgr.14140) 229 : cluster [DBG] pgmap v176: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:30.901 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:30.902 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:31.567 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2021-02-10T23:48:29.317297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.432}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48399999999999999}]}]}]}} 2021-02-10T23:48:31.568 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:31.713 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:32.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:32 gibba001 conmon[29242]: audit 2021-02-10T23:48:30.902195+0000 mgr.x (mgr.14140) 230 : audit [DBG] from='client.14362 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:32 gibba001 conmon[29242]: cluster 2021-02-10T23:48:31.318136+0000 mgr.x (mgr.14140) 231 : cluster [DBG] pgmap v177: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:33.256 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:33.256 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":371,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:33.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:33 gibba001 conmon[29242]: audit 2021-02-10T23:48:33.257827+0000 mon.a (mon.0) 247 : audit [DBG] from='client.? 172.21.2.101:0/180519445' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:33.858 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:33.859 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:34.005 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:34.515 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:34 gibba001 conmon[29242]: cluster 2021-02-10T23:48:33.318384+0000 mgr.x (mgr.14140) 232 : cluster [DBG] pgmap v178: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:35.583 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:35.584 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:36.157 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2021-02-10T23:48:35.318660+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738431,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.377}]}]}]}} 2021-02-10T23:48:36.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:36 gibba001 conmon[29242]: cluster 2021-02-10T23:48:35.318782+0000 mgr.x (mgr.14140) 233 : cluster [DBG] pgmap v179: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:37.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:37 gibba001 conmon[29242]: audit 2021-02-10T23:48:35.584449+0000 mgr.x (mgr.14140) 234 : audit [DBG] from='client.14366 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:38.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:38 gibba001 conmon[29242]: cluster 2021-02-10T23:48:37.319417+0000 mgr.x (mgr.14140) 235 : cluster [DBG] pgmap v180: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:39.160 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:39.306 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:40.668 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:40 gibba001 conmon[29242]: cluster 2021-02-10T23:48:39.319820+0000 mgr.x (mgr.14140) 236 : cluster [DBG] pgmap v181: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:40.873 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:40.874 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:41.458 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":181,"stamp":"2021-02-10T23:48:39.319594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.53000000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738432,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.38700000000000001}]}]}]}} 2021-02-10T23:48:41.459 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:41.604 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:42.854 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:42 gibba001 conmon[29242]: audit 2021-02-10T23:48:40.874267+0000 mgr.x (mgr.14140) 237 : audit [DBG] from='client.14368 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:42.854 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:42 gibba001 conmon[29242]: cluster 2021-02-10T23:48:41.320395+0000 mgr.x (mgr.14140) 238 : cluster [DBG] pgmap v182: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:43.158 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:43.158 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":381,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:43.727 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:43 gibba001 conmon[29242]: audit 2021-02-10T23:48:43.160383+0000 mon.a (mon.0) 248 : audit [DBG] from='client.? 172.21.2.101:0/3145546416' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:43.741 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:43.742 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:43.889 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:44.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:44 gibba001 conmon[29242]: cluster 2021-02-10T23:48:43.320791+0000 mgr.x (mgr.14140) 239 : cluster [DBG] pgmap v183: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:45.468 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:45.469 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:46.072 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2021-02-10T23:48:45.321057+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.496}]}]},{"osd":0,"up_from":8,"seq":34359738433,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40000000000000002}]}]}]}} 2021-02-10T23:48:46.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:46 gibba001 conmon[29242]: cluster 2021-02-10T23:48:45.321183+0000 mgr.x (mgr.14140) 240 : cluster [DBG] pgmap v184: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:46.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:46 gibba001 conmon[29242]: audit 2021-02-10T23:48:45.468998+0000 mgr.x (mgr.14140) 241 : audit [DBG] from='client.14372 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:47.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:47 gibba001 conmon[29242]: cluster 2021-02-10T23:48:47.321851+0000 mgr.x (mgr.14140) 242 : cluster [DBG] pgmap v185: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:49.224 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:49.373 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:50.705 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:50 gibba001 conmon[29242]: cluster 2021-02-10T23:48:49.322133+0000 mgr.x (mgr.14140) 243 : cluster [DBG] pgmap v186: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:50.958 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:50.959 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:51.574 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2021-02-10T23:48:49.321991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.496}]}]},{"osd":0,"up_from":8,"seq":34359738434,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35999999999999999}]}]}]}} 2021-02-10T23:48:51.575 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:48:51.720 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:52.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:52 gibba001 conmon[29242]: audit 2021-02-10T23:48:50.959080+0000 mgr.x (mgr.14140) 244 : audit [DBG] from='client.14374 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:52.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:52 gibba001 conmon[29242]: cluster 2021-02-10T23:48:51.322851+0000 mgr.x (mgr.14140) 245 : cluster [DBG] pgmap v187: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:53.230 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:53.230 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":391,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:48:53.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:48:53 gibba001 conmon[29628]: debug 2021-02-10T23:48:53.260+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:48:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:53 gibba001 conmon[29242]: audit 2021-02-10T23:48:53.231903+0000 mon.a (mon.0) 249 : audit [DBG] from='client.? 172.21.2.101:0/1325965081' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:48:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:53 gibba001 conmon[29242]: audit 2021-02-10T23:48:53.360564+0000 mon.a (mon.0) 250 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:48:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:53 gibba001 conmon[29242]: audit 2021-02-10T23:48:53.360697+0000 mon.a (mon.0) 251 : 2021-02-10T23:48:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:53 gibba001 conmon[29242]: audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:48:53.804 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:48:53.804 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:53.951 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:48:54.450 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:54 gibba001 conmon[29242]: cluster 2021-02-10T23:48:53.323169+0000 mgr.x (mgr.14140) 246 : cluster [DBG] pgmap v188: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:55.518 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:48:55.519 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:48:56.066 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2021-02-10T23:48:55.323280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.53400000000000003}]}]}]}} 2021-02-10T23:48:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:56 gibba001 conmon[29242]: cluster 2021-02-10T23:48:55.323428+0000 mgr.x (mgr.14140) 247 : cluster [DBG] pgmap v189: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:57.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:57 gibba001 conmon[29242]: audit 2021-02-10T23:48:55.519510+0000 mgr.x (mgr.14140) 248 : audit [DBG] from='client.14378 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:48:58.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:48:58 gibba001 conmon[29242]: cluster 2021-02-10T23:48:57.323755+0000 mgr.x (mgr.14140) 249 : cluster [DBG] pgmap v190: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:48:59.068 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:48:59.213 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:00.611 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:00 gibba001 conmon[29242]: cluster 2021-02-10T23:48:59.324041+0000 mgr.x (mgr.14140) 250 : cluster [DBG] pgmap v191: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:00.815 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:00.816 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:01.408 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":191,"stamp":"2021-02-10T23:48:59.323921+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.434,"15min":0.44400000000000001},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.54500000000000004,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45100000000000001,"15min":0.45300000000000001},"min":{"1min":0.32600000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.56000000000000005,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738436,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:47:57 2021","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.437,"15min":0.46600000000000003},"min":{"1min":0.28000000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.52000000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.442,"15min":0.46200000000000002},"min":{"1min":0.30299999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.35599999999999998}]}]}]}} 2021-02-10T23:49:01.409 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:01.557 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:02.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:02 gibba001 conmon[29242]: audit 2021-02-10T23:49:00.815966+0000 mgr.x (mgr.14140) 251 : audit [DBG] from='client.14380 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:02 gibba001 conmon[29242]: cluster 2021-02-10T23:49:01.324652+0000 mgr.x (mgr.14140) 252 : cluster [DBG] pgmap v192: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:03.211 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:03.211 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":401,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:03.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:03 gibba001 conmon[29242]: audit 2021-02-10T23:49:03.213205+0000 mon.a (mon.0) 252 : audit [DBG] from='client.? 172.21.2.101:0/3296476818' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:03.756 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:03.757 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:03.903 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:04.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:04 gibba001 conmon[29242]: cluster 2021-02-10T23:49:03.324920+0000 mgr.x (mgr.14140) 253 : cluster [DBG] pgmap v193: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:05.424 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:05.425 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:06.041 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":194,"stamp":"2021-02-10T23:49:05.325056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38}]}]},{"osd":0,"up_from":8,"seq":34359738437,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.438},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41099999999999998}]}]}]}} 2021-02-10T23:49:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:06 gibba001 conmon[29242]: cluster 2021-02-10T23:49:05.325212+0000 mgr.x (mgr.14140) 254 : cluster [DBG] pgmap v194: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:06 gibba001 conmon[29242]: audit 2021-02-10T23:49:05.425234+0000 mgr.x (mgr.14140) 255 : audit [DBG] from='client.14384 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:07.959 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:07 gibba001 conmon[29242]: cluster 2021-02-10T23:49:07.325867+0000 mgr.x (mgr.14140) 256 : cluster [DBG] pgmap v195: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:09.288 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:09.436 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:10.654 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:10 gibba001 conmon[29242]: cluster 2021-02-10T23:49:09.326150+0000 mgr.x (mgr.14140) 257 : cluster [DBG] pgmap v196: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:10.909 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:10.910 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:11.508 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2021-02-10T23:49:09.326002+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574913,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.38}]}]},{"osd":0,"up_from":8,"seq":34359738438,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40600000000000003}]}]}]}} 2021-02-10T23:49:11.509 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:11.657 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:12.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:12 gibba001 conmon[29242]: audit 2021-02-10T23:49:10.909699+0000 mgr.x (mgr.14140) 258 : audit [DBG] from='client.14386 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:12.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:12 gibba001 conmon[29242]: cluster 2021-02-10T23:49:11.326479+0000 mgr.x (mgr.14140) 259 : cluster [DBG] pgmap v197: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:13.185 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:13.185 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":411,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:13.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:13 gibba001 conmon[29242]: audit 2021-02-10T23:49:13.186655+0000 mon.a (mon.0) 253 : audit [DBG] from='client.? 172.21.2.101:0/1998845627' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:13.789 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:13.790 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:13.939 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:14.433 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:14 gibba001 conmon[29242]: cluster 2021-02-10T23:49:13.326890+0000 mgr.x (mgr.14140) 260 : cluster [DBG] pgmap v198: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:15.558 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:15.559 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:16.175 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":199,"stamp":"2021-02-10T23:49:15.327035+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738439,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.41399999999999998}]}]}]}} 2021-02-10T23:49:16.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:16 gibba001 conmon[29242]: cluster 2021-02-10T23:49:15.327228+0000 mgr.x (mgr.14140) 261 : cluster [DBG] pgmap v199: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:17.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:17 gibba001 conmon[29242]: audit 2021-02-10T23:49:15.559119+0000 mgr.x (mgr.14140) 262 : audit [DBG] from='client.14390 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:18.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:18 gibba001 conmon[29242]: cluster 2021-02-10T23:49:17.327629+0000 mgr.x (mgr.14140) 263 : cluster [DBG] pgmap v200: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:19.176 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:19.324 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:20.657 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:20 gibba001 conmon[29242]: cluster 2021-02-10T23:49:19.327875+0000 mgr.x (mgr.14140) 264 : cluster [DBG] pgmap v201: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:20.908 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:20.909 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:21.586 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2021-02-10T23:49:19.327759+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.41399999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.36699999999999999}]}]}]}} 2021-02-10T23:49:21.587 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:21.734 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:22.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:22 gibba001 conmon[29242]: audit 2021-02-10T23:49:20.909353+0000 mgr.x (mgr.14140) 265 : audit [DBG] from='client.14392 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:22 gibba001 conmon[29242]: cluster 2021-02-10T23:49:21.328173+0000 mgr.x (mgr.14140) 266 : cluster [DBG] pgmap v202: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:23.311 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:23.311 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":421,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:23.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:23 gibba001 conmon[29242]: audit 2021-02-10T23:49:23.312070+0000 mon.a (mon.0) 254 : audit [DBG] from='client.? 172.21.2.101:0/3474472122' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:23.915 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:23.916 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:24.066 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:24.548 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:24 gibba001 conmon[29242]: cluster 2021-02-10T23:49:23.328568+0000 mgr.x (mgr.14140) 267 : cluster [DBG] pgmap v203: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:25.634 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:25.635 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:26.307 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":204,"stamp":"2021-02-10T23:49:25.328782+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738441,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.45100000000000001}]}]}]}} 2021-02-10T23:49:26.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:26 gibba001 conmon[29242]: cluster 2021-02-10T23:49:25.328902+0000 mgr.x (mgr.14140) 268 : cluster [DBG] pgmap v204: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:27.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:27 gibba001 conmon[29242]: audit 2021-02-10T23:49:25.635249+0000 mgr.x (mgr.14140) 269 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:28.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:28 gibba001 conmon[29242]: cluster 2021-02-10T23:49:27.329357+0000 mgr.x (mgr.14140) 270 : cluster [DBG] pgmap v205: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:29.308 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:29.454 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:30.704 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:30 gibba001 conmon[29242]: cluster 2021-02-10T23:49:29.329670+0000 mgr.x (mgr.14140) 271 : cluster [DBG] pgmap v206: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:30.960 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:30.961 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:31.573 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":206,"stamp":"2021-02-10T23:49:29.329503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.499}]}]}]}} 2021-02-10T23:49:31.573 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:31.718 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:32.459 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:32 gibba001 conmon[29242]: audit 2021-02-10T23:49:30.960947+0000 mgr.x (mgr.14140) 272 : audit [DBG] from='client.14398 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:32.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:32 gibba001 conmon[29242]: cluster 2021-02-10T23:49:31.330112+0000 mgr.x (mgr.14140) 273 : cluster [DBG] pgmap v207: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:33.346 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:33.346 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":431,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:33.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:33 gibba001 conmon[29242]: audit 2021-02-10T23:49:33.347965+0000 mon.a (mon.0) 255 : audit [DBG] from='client.? 172.21.2.101:0/3283954948' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:34.000 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:34.000 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:34.148 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:34.648 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:34 gibba001 conmon[29242]: cluster 2021-02-10T23:49:33.330357+0000 mgr.x (mgr.14140) 274 : cluster [DBG] pgmap v208: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:35.699 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:35.700 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:36.256 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":209,"stamp":"2021-02-10T23:49:35.330605+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.312},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738443,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.56999999999999995}]}]}]}} 2021-02-10T23:49:36.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:36 gibba001 conmon[29242]: cluster 2021-02-10T23:49:35.330723+0000 mgr.x (mgr.14140) 275 : cluster [DBG] pgmap v209: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:37.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:37 gibba001 conmon[29242]: audit 2021-02-10T23:49:35.699949+0000 mgr.x (mgr.14140) 276 : audit [DBG] from='client.14402 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:38.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:38 gibba001 conmon[29242]: cluster 2021-02-10T23:49:37.331181+0000 mgr.x (mgr.14140) 277 : cluster [DBG] pgmap v210: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:39.257 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:39.406 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:40.678 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:40 gibba001 conmon[29242]: cluster 2021-02-10T23:49:39.331445+0000 mgr.x (mgr.14140) 278 : cluster [DBG] pgmap v211: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:40.885 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:40.886 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:41.500 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2021-02-10T23:49:39.331319+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.312},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738444,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.40999999999999998}]}]}]}} 2021-02-10T23:49:41.501 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:41.648 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:42.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:42 gibba001 conmon[29242]: audit 2021-02-10T23:49:40.886323+0000 mgr.x (mgr.14140) 279 : audit [DBG] from='client.14404 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:42.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:42 gibba001 conmon[29242]: cluster 2021-02-10T23:49:41.331914+0000 mgr.x (mgr.14140) 280 : cluster [DBG] pgmap v212: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:43.301 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:43.301 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":441,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:43.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:43 gibba001 conmon[29242]: audit 2021-02-10T23:49:43.302933+0000 mon.a (mon.0) 256 : audit [DBG] from='client.? 172.21.2.101:0/3051379481' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:43.867 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:43.867 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:44.013 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:44.515 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:44 gibba001 conmon[29242]: cluster 2021-02-10T23:49:43.332396+0000 mgr.x (mgr.14140 2021-02-10T23:49:44.515 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:44 gibba001 conmon[29242]: ) 281 : cluster [DBG] pgmap v213: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:45.601 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:45.603 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:46.234 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2021-02-10T23:49:45.332664+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.433}]}]},{"osd":0,"up_from":8,"seq":34359738445,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.432},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.48299999999999998}]}]}]}} 2021-02-10T23:49:46.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:46 gibba001 conmon[29242]: cluster 2021-02-10T23:49:45.332786+0000 mgr.x (mgr.14140) 282 : cluster [DBG] pgmap v214: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:47.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:47 gibba001 conmon[29242]: audit 2021-02-10T23:49:45.602682+0000 mgr.x (mgr.14140) 283 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:48 gibba001 conmon[29242]: cluster 2021-02-10T23:49:47.333399+0000 mgr.x (mgr.14140) 284 : cluster [DBG] pgmap v215: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:49.237 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:49.384 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:50.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:50 gibba001 conmon[29242]: cluster 2021-02-10T23:49:49.333809+0000 mgr.x (mgr.14140) 285 : cluster [DBG] pgmap v216: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:50.852 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:50.854 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:51.493 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2021-02-10T23:49:49.333526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574921,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.433}]}]},{"osd":0,"up_from":8,"seq":34359738446,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.371},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.437}]}]}]}} 2021-02-10T23:49:51.592 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:49:51.738 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:52.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:52 gibba001 conmon[29242]: audit 2021-02-10T23:49:50.853526+0000 mgr.x (mgr.14140) 286 : audit [DBG] from='client.14410 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:52.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:52 gibba001 conmon[29242]: cluster 2021-02-10T23:49:51.334511+0000 mgr.x (mgr.14140) 287 : cluster [DBG] pgmap v217: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:53.260 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:53.260 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":451,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:49:53.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:49:53 gibba001 conmon[29628]: debug 2021-02-10T23:49:53.260+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:49:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:53 gibba001 conmon[29242]: audit 2021-02-10T23:49:53.261762+0000 mon.a (mon.0) 257 : audit [DBG] from='client.? 172.21.2.101:0/3324665579' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:49:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:53 gibba001 conmon[29242]: audit 2021-02-10T23:49:53.362481+0000 mon.a (mon.0) 258 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:49:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:53 gibba001 conmon[29242]: audit 2021-02-10T23:49: 2021-02-10T23:49:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:53 gibba001 conmon[29242]: 53.362599+0000 mon.a (mon.0) 259 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:49:53.881 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:49:53.882 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:54.033 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:49:54.528 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:54 gibba001 conmon[29242]: cluster 2021-02-10T23:49:53.334826+0000 mgr.x (mgr.14140) 288 : cluster [DBG] pgmap v218: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:55.609 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:49:55.610 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:49:56.221 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":219,"stamp":"2021-02-10T23:49:55.335118+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738447,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.502},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.58199999999999996}]}]}]}} 2021-02-10T23:49:56.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:56 gibba001 conmon[29242]: cluster 2021-02-10T23:49:55.335280+0000 mgr.x (mgr.14140) 289 : cluster [DBG] pgmap v219: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:57.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:57 gibba001 conmon[29242]: audit 2021-02-10T23:49:55.609961+0000 mgr.x (mgr.14140) 290 : audit [DBG] from='client.14414 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:49:58.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:49:58 gibba001 conmon[29242]: cluster 2021-02-10T23:49:57.335501+0000 mgr.x (mgr.14140) 291 : cluster [DBG] pgmap v220: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:49:59.222 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:49:59.369 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:00.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:00 gibba001 conmon[29242]: cluster 2021-02-10T23:49:59.335753+0000 mgr.x (mgr.14140) 292 : cluster [DBG] pgmap v221: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:00.833 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:00.834 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:01.404 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2021-02-10T23:49:59.335641+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738448,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:48:59 2021","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.41999999999999998,"15min":0.46000000000000002},"min":{"1min":0.29099999999999998,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.51700000000000002,"5min":0.66100000000000003,"15min":0.66100000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.437,"5min":0.435,"15min":0.46000000000000002},"min":{"1min":0.33800000000000002,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58099999999999996,"5min":0.69999999999999996,"15min":0.69999999999999996},"last":0.46700000000000003}]}]}]}} 2021-02-10T23:50:01.405 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:01.553 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:02 gibba001 conmon[29242]: audit 2021-02-10T23:50:00.834128+0000 mgr.x (mgr.14140) 293 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:02 gibba001 conmon[29242]: cluster 2021-02-10T23:50:01.336298+0000 mgr.x (mgr.14140) 294 : cluster [DBG] pgmap v222: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:03.068 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:03.068 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":461,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:03.659 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:03.659 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:03.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:03 gibba001 conmon[29242]: audit 2021-02-10T23:50:03.069306+0000 mon.a (mon.0) 260 : audit [DBG] from='client.? 172.21.2.101:0/1152220131' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:03.804 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:04.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:04 gibba001 conmon[29242]: cluster 2021-02-10T23:50:03.336877+0000 mgr.x (mgr.14140) 295 : cluster [DBG] pgmap v223: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:05.261 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:05.262 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:05.865 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":223,"stamp":"2021-02-10T23:50:03.336760+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:48:58 2021","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.435,"15min":0.44400000000000001},"min":{"1min":0.32500000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.56599999999999995,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45200000000000001,"15min":0.45300000000000001},"min":{"1min":0.34799999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.59999999999999998,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.51100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.45200000000000001}]}]}]}} 2021-02-10T23:50:06.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:06 gibba001 conmon[29242]: audit 2021-02-10T23:50:05.261768+0000 mgr.x (mgr.14140) 296 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:06 gibba001 conmon[29242]: cluster 2021-02-10T23:50:05.337167+0000 mgr.x (mgr.14140) 297 : cluster [DBG] pgmap v224: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:08.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:07 gibba001 conmon[29242]: cluster 2021-02-10T23:50:07.337913+0000 mgr.x (mgr.14140) 298 : cluster [DBG] pgmap v225: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:08.867 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:09.013 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:10.582 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:10.583 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:10.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:10 gibba001 conmon[29242]: cluster 2021-02-10T23:50:09.338185+0000 mgr.x (mgr.14140) 299 : cluster [DBG] pgmap v226: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:11.199 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2021-02-10T23:50:09.338056+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574925,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.379}]}]},{"osd":0,"up_from":8,"seq":34359738450,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.57599999999999996}]}]}]}} 2021-02-10T23:50:11.199 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:11.347 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:12.688 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:12 gibba001 conmon[29242]: audit 2021-02-10T23:50:10.583348+0000 mgr.x (mgr.14140) 300 : audit [DBG] from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:12.895 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:12 gibba001 conmon[29242]: cluster 2021-02-10T23:50:11.338476+0000 mgr.x (mgr.14140) 301 : cluster [DBG] pgmap v227: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:12.978 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:12.978 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":471,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:13.595 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:13.596 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:13.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:13 gibba001 conmon[29242]: audit 2021-02-10T23:50:12.979641+0000 mon.a (mon.0) 261 : audit [DBG] from='client.? 172.21.2.101:0/4083451269' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:13.748 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:14 gibba001 conmon[29242]: cluster 2021-02-10T23:50:13.338855+0000 mgr.x (mgr.14140) 302 : cluster [DBG] pgmap v228: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:15.268 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:15.268 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:15.892 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":228,"stamp":"2021-02-10T23:50:13.338740+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.58099999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.34499999999999997}]}]}]}} 2021-02-10T23:50:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:16 gibba001 conmon[29242]: audit 2021-02-10T23:50:15.267869+0000 mgr.x (mgr.14140) 303 : audit [DBG] from='client.14426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:16 gibba001 conmon[29242]: cluster 2021-02-10T23:50:15.339200+0000 mgr.x (mgr.14140) 304 : cluster [DBG] pgmap v229: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:17 gibba001 conmon[29242]: cluster 2021-02-10T23:50:17.339926+0000 mgr.x (mgr.14140) 305 : cluster [DBG] pgmap v230: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:18.893 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:19.040 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:20.567 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:20.568 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:20.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:20 gibba001 conmon[29242]: cluster 2021-02-10T23:50:19.340186+0000 mgr.x (mgr.14140) 306 : cluster [DBG] pgmap v231: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:21.174 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":231,"stamp":"2021-02-10T23:50:19.340059+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574927,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32700000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738452,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.48999999999999999}]}]}]}} 2021-02-10T23:50:21.175 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:21.320 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:22.646 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:22 gibba001 conmon[29242]: audit 2021-02-10T23:50:20.567874+0000 mgr.x (mgr.14140) 307 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:22.646 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:22 gibba001 conmon[29242]: cluster 2021-02-10T23:50:21.340424+0000 mgr.x (mgr.14140) 308 : cluster [DBG] pgmap v232: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:22.944 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:22.945 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":481,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:23.575 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:23.576 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:23.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:23 gibba001 conmon[29242]: audit 2021-02-10T23:50:22.946215+0000 mon.a (mon.0) 262 : audit [DBG] from='client.? 172.21.2.101:0/2418447327' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:24.090 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:24 gibba001 conmon[29242]: cluster 2021-02-10T23:50:23.341123+0000 mgr.x (mgr.14140) 309 : cluster [DBG] pgmap v233: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:25.309 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:25.310 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:25.908 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2021-02-10T23:50:23.340987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.495}]}]},{"osd":0,"up_from":8,"seq":34359738453,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.41299999999999998}]}]}]}} 2021-02-10T23:50:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:26 gibba001 conmon[29242]: audit 2021-02-10T23:50:25.309727+0000 mgr.x (mgr.14140) 310 : audit [DBG] from='client.14432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:26 gibba001 conmon[29242]: cluster 2021-02-10T23:50:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:26 gibba001 conmon[29242]: 2021-02-10T23:50:25.341454+0000 mgr.x (mgr.14140) 311 : cluster [DBG] pgmap v234: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:27 gibba001 conmon[29242]: cluster 2021-02-10T23:50:27.342128+0000 mgr.x (mgr.14140) 312 : cluster [DBG] pgmap v235: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:28.910 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:29.055 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:30.553 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:30.554 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:30 gibba001 conmon[29242]: cluster 2021-02-10T23:50:29.342441+0000 mgr.x (mgr.14140) 313 : cluster [DBG] pgmap v236: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:31.158 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2021-02-10T23:50:29.342323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.40699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738454,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.51500000000000001}]}]}]}} 2021-02-10T23:50:31.159 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:31.305 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:32.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:32 gibba001 conmon[29242]: audit 2021-02-10T23:50:30.553778+0000 mgr.x (mgr.14140) 314 : audit [DBG] from='client.14434 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:32.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:32 gibba001 conmon[29242]: cluster 2021-02-10T23:50:31.342735+0000 mgr.x (mgr.14140) 315 : cluster [DBG] pgmap v237: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:32.664 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:32 gibba001 conmon[29242]: 2021-02-10T23:50:32.920 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:32.920 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":491,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:33.548 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:33.549 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:33.693 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:33.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:33 gibba001 conmon[29242]: audit 2021-02-10T23:50:32.921872+0000 mon.a (mon.0) 263 : audit [DBG] from='client.? 172.21.2.101:0/3067830049' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:34.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:34 gibba001 conmon[29242]: cluster 2021-02-10T23:50:33.343326+0000 mgr.x (mgr.14140) 316 : cluster [DBG] pgmap v238: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:35.210 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:35.211 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:35.788 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":238,"stamp":"2021-02-10T23:50:33.343211+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.5}]}]},{"osd":0,"up_from":8,"seq":34359738455,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.438}]}]}]}} 2021-02-10T23:50:36.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:36 gibba001 conmon[29242]: audit 2021-02-10T23:50:35.211001+0000 mgr.x (mgr.14140) 317 : audit [DBG] from='client.14438 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:36.712 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:36 gibba001 conmon[29242]: cluster 2021-02-10T23:50:35.343559+0000 mgr.x (mgr.14140) 318 : cluster [DBG] pgmap v239: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:38.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:37 gibba001 conmon[29242]: cluster 2021-02-10T23:50:37.343993+0000 mgr.x (mgr.14140) 319 : cluster [DBG] pgmap v240: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:38.790 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:38.936 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:40.451 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:40.452 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:40.665 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:40 gibba001 conmon[29242]: cluster 2021-02-10T23:50:39.344238+0000 mgr.x (mgr.14140) 320 : cluster [DBG] pgmap v241: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:41.050 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":241,"stamp":"2021-02-10T23:50:39.344133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574931,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738456,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.47399999999999998}]}]}]}} 2021-02-10T23:50:41.051 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:41.197 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:41.670 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:41 gibba001 conmon[29242]: audit 2021-02-10T23:50:40.451461+0000 mgr.x (mgr.14140) 321 : audit [DBG] from='client.14440 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:42.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:42 gibba001 conmon[29242]: cluster 2021-02-10T23:50:41.344688+0000 mgr.x (mgr.14140) 322 : cluster [DBG] pgmap v242: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:42.718 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:42.719 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":501,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:43.306 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:43.306 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:43.455 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:43.679 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:43 gibba001 conmon[29242]: audit 2021-02-10T23:50:42.720296+0000 mon.a (mon.0) 264 : audit [DBG] from='client.? 172.21.2.101:0/1775275715' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:44.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:44 gibba001 conmon[29242]: cluster 2021-02-10T23:50:43.344956+0000 mgr.x (mgr.14140) 323 : cluster [DBG] pgmap v243: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:45.016 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:45.017 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:45.584 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":243,"stamp":"2021-02-10T23:50:43.344838+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.48899999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.44700000000000001}]}]}]}} 2021-02-10T23:50:46.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:46 gibba001 conmon[29242]: audit 2021-02-10T23:50:45.016913+0000 mgr.x (mgr.14140) 324 : audit [DBG] from='client.14444 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:46.745 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:46 gibba001 conmon[29242]: cluster 2021-02-10T23: 2021-02-10T23:50:46.746 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:46 gibba001 conmon[29242]: 50:45.345400+0000 mgr.x (mgr.14140) 325 : cluster [DBG] pgmap v244: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:48.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:47 gibba001 conmon[29242]: cluster 2021-02-10T23:50:47.346056+0000 mgr.x (mgr.14140) 326 : cluster [DBG] pgmap v245: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:48.658 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:48.803 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:50.415 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:50.416 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:50.673 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:50 gibba001 conmon[29242]: cluster 2021-02-10T23:50:49.346645+0000 mgr.x (mgr.14140) 327 : cluster [DBG] pgmap v246: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:51.065 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":246,"stamp":"2021-02-10T23:50:49.346526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.43099999999999999}]}]}]}} 2021-02-10T23:50:51.066 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:50:51.211 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:51.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:51 gibba001 conmon[29242]: audit 2021-02-10T23:50:50.416091+0000 mgr.x (mgr.14140) 328 : audit [DBG] from='client.14446 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:52.557 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:52 gibba001 conmon[29242]: cluster 2021-02-10T23:50:51.347076+0000 mgr.x (mgr.14140) 329 : cluster [DBG] pgmap v247: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:52.810 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:52.811 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":511,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:50:53.413 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:50:53.413 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:53.560 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:50:53.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:50:53 gibba001 conmon[29628]: debug 2021-02-10T23:50:53.262+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:50:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:53 gibba001 conmon[29242]: audit 2021-02-10T23:50:52.811982+0000 mon.a (mon.0) 265 : audit [DBG] from='client.? 172.21.2.101:0/2058122040' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:50:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:53 gibba001 conmon[29242]: audit 2021-02-10T23:50: 2021-02-10T23:50:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:53 gibba001 conmon[29242]: 53.364352+0000 mon.a (mon.0) 266 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:50:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:53 gibba001 conmon[29242]: audit 2021-02-10T23:50:53.364474+0000 mon.a (mon.0) 267 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:50:54.694 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:54 gibba001 conmon[29242]: cluster 2021-02-10T23:50:53.347412+0000 mgr.x (mgr.14140) 330 : cluster [DBG] pgmap v248: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:55.159 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:50:55.160 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:50:55.833 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":248,"stamp":"2021-02-10T23:50:53.347287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738459,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.36599999999999999}]}]}]}} 2021-02-10T23:50:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:56 gibba001 conmon[29242]: audit 2021-02-10T23:50:55.159639+0000 mgr.x (mgr.14140) 331 : audit [DBG] from='client.14450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:50:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:56 gibba001 conmon[29242]: cluster 2021-02-10T23:50:55.347812+0000 mgr.x (mgr.14140) 332 : cluster [DBG] pgmap v249: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:58.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:50:57 gibba001 conmon[29242]: cluster 2021-02-10T23:50:57.348348+0000 mgr.x (mgr.14140) 333 : cluster [DBG] pgmap v250: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:50:58.834 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:50:58.983 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:00.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:00 gibba001 conmon[29242]: cluster 2021-02-10T23:50:59.348615+0000 mgr.x (mgr.14140) 334 : cluster [DBG] 2021-02-10T23:51:00.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:00 gibba001 conmon[29242]: pgmap v251: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:00.602 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:00.603 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:01.221 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":251,"stamp":"2021-02-10T23:50:59.348497+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.60799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.51000000000000001}]}]}]}} 2021-02-10T23:51:01.222 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:01.369 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:02.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:02 gibba001 conmon[29242]: audit 2021-02-10T23:51:00.603136+0000 mgr.x (mgr.14140) 335 : audit [DBG] from='client.14452 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:02.664 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:02 gibba001 conmon[29242]: cluster 2021-02-10T23:51:01.348886+0000 mgr.x (mgr.14140) 336 : cluster [DBG] pgmap v252: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:02.918 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:02.919 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":521,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:03.498 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:03.498 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:03.646 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:03.709 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:03 gibba001 conmon[29242]: audit 2021-02-10T23:51:02.919706+0000 mon.a (mon.0) 268 : audit [DBG] from='client.? 172.21.2.101:0/906911975' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:04.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:04 gibba001 conmon[29242]: cluster 2021-02-10T23:51:03.349410+0000 mgr.x (mgr.14140) 337 : cluster [DBG] pgmap v253: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:05.308 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:05.318 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:05.879 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":253,"stamp":"2021-02-10T23:51:03.349236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:49:59 2021","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.42999999999999999,"15min":0.442},"min":{"1min":0.29799999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.624,"5min":0.624,"15min":0.624},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.44,"5min":0.44900000000000001,"15min":0.45200000000000001},"min":{"1min":0.34499999999999997,"5min":0.314,"15min":0.314},"max":{"1min":0.59199999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.58999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:50:01 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.40899999999999997,"15min":0.45700000000000002},"min":{"1min":0.34200000000000003,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.433,"15min":0.45900000000000002},"min":{"1min":0.36699999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69999999999999996},"last":0.34300000000000003}]}]}]}} 2021-02-10T23:51:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:06 gibba001 conmon[29242]: audit 2021-02-10T23:51:05.308784+0000 mgr.x (mgr.14140) 338 : audit [DBG] from='client.14456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:06 gibba001 conmon[29242]: cluster 2021-02-10T23:51:05.349642+0000 mgr.x (mgr.14140) 339 : cluster [DBG] pgmap v254: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:08.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:07 gibba001 conmon[29242]: cluster 2021-02-10T23:51:07.350298+0000 mgr.x (mgr.14140) 340 : cluster [DBG] pgmap v255: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:08.880 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:09.028 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:10.473 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:10 gibba001 conmon[29242]: cluster 2021-02-10T23:51:09.350538+0000 mgr.x (mgr.14140) 341 : cluster [DBG] pgmap v256: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:10.684 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:10.686 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:11.316 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":256,"stamp":"2021-02-10T23:51:09.350411+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574937,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.49299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.41499999999999998}]}]}]}} 2021-02-10T23:51:11.317 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:11.466 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:12 gibba001 conmon[29242]: audit 2021-02-10T23:51:10.685615+0000 mgr.x (mgr.14140) 342 : audit [DBG] from='client.14458 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:12 gibba001 conmon[29242]: cluster 2021-02-10T23:51:11.350805+0000 mgr.x (mgr.14140) 343 : cluster [DBG] pgmap v257: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:13.118 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:13.119 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":531,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:13.698 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:13 gibba001 conmon[29242]: audit 2021-02-10T23:51:13.119897+0000 mon.a (mon.0) 269 : audit [DBG] from='client.? 172.21.2.101:0/999192339' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:13.704 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:13.704 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:13.853 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:14 gibba001 conmon[29242]: cluster 2021-02-10T23:51:13.351223+0000 mgr.x (mgr.14140) 344 : cluster [DBG] pgmap v258: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:14 gibba001 conmon[29242]: 2021-02-10T23:51:15.386 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:15.388 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:15.991 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":259,"stamp":"2021-02-10T23:51:15.351339+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.32900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738463,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.47099999999999997}]}]}]}} 2021-02-10T23:51:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:16 gibba001 conmon[29242]: cluster 2021-02-10T23:51:15.351498+0000 mgr.x (mgr.14140) 345 : cluster [DBG] pgmap v259: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:16 gibba001 conmon[29242]: audit 2021-02-10T23:51:15.387461+0000 mgr.x (mgr.14140) 346 : audit [DBG] from='client.14462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:17 gibba001 conmon[29242]: cluster 2021-02-10T23:51:17.351828+0000 mgr.x (mgr.14140) 347 : cluster [DBG] pgmap v260: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:19.024 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:19.171 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:20.590 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:20 gibba001 conmon[29242]: cluster 2021-02-10T23:51:19.352334+0000 mgr.x (mgr.14140) 348 : cluster [DBG] pgmap v261: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:20.803 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:20.804 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:21.400 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2021-02-10T23:51:19.352216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574939,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.32900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738464,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.41099999999999998}]}]}]}} 2021-02-10T23:51:21.401 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:21.551 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:22 gibba001 conmon[29242]: audit 2021-02-10T23:51:20.801002+0000 mgr.x (mgr.14140) 349 : audit [DBG] from='client.14464 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:22 gibba001 conmon[29242]: cluster 2021-02-10T23:51:21.352652+0000 mgr.x (mgr.14140) 350 : cluster [DBG] pgmap v262: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:23.128 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:23.128 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":541,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:23.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:23 gibba001 conmon[29242]: audit 2021-02-10T23:51:23.129558+0000 mon.a (mon.0) 270 : audit [DBG] from='client.? 172.21.2.101:0/128260114' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:23.788 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:23.788 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:23.935 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:24 gibba001 conmon[29242]: cluster 2021-02-10T23:51:23.353049+0000 mgr.x (mgr.14140) 351 : cluster [DBG] pgmap v263: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:25.478 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:25.479 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:26.118 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":264,"stamp":"2021-02-10T23:51:25.353198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.46899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738465,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.56000000000000005}]}]}]}} 2021-02-10T23:51:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:26 gibba001 conmon[29242]: cluster 2021-02-10T23:51:25.353316+0000 mgr.x (mgr.14140) 352 : cluster [DBG] pgmap v264: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:26 gibba001 conmon[29242]: audit 2021-02-10T23: 2021-02-10T23:51:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:26 gibba001 conmon[29242]: 51:25.478256+0000 mgr.x (mgr.14140) 353 : audit [DBG] from='client.14468 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:27 gibba001 conmon[29242]: cluster 2021-02-10T23:51:27.354017+0000 mgr.x (mgr.14140) 354 : cluster [DBG] pgmap v265: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:29.120 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:29.268 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:30 gibba001 conmon[29242]: cluster 2021-02-10T23:51:29.354293+0000 mgr.x (mgr.14140) 355 : cluster [DBG] pgmap v266: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:30.734 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:30.735 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:31.354 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":266,"stamp":"2021-02-10T23:51:29.354189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574941,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.46899999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738466,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.443}]}]}]}} 2021-02-10T23:51:31.355 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:31.506 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:32 gibba001 conmon[29242]: audit 2021-02-10T23:51:30.735021+0000 mgr.x (mgr.14140) 356 : audit [DBG] from='client.14470 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:32 gibba001 conmon[29242]: cluster 2021-02-10T23:51:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:32 gibba001 conmon[29242]: 2021-02-10T23:51:31.354572+0000 mgr.x (mgr.14140) 357 : cluster [DBG] pgmap v267: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:33.117 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:33.117 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":551,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:33.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:33 gibba001 conmon[29242]: audit 2021-02-10T23:51:33.118381+0000 mon.a (mon.0) 271 : audit [DBG] from='client.? 172.21.2.101:0/3430643274' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:33.852 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:33.852 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:33.998 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:34.509 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:34 gibba001 conmon[29242]: cluster 2021-02-10T23:51:33.354830+0000 mgr.x (mgr.14140) 358 : cluster [DBG] pgmap v268: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:35.568 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:35.569 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:36.213 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":269,"stamp":"2021-02-10T23:51:35.354971+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.379}]}]},{"osd":0,"up_from":8,"seq":34359738467,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.377}]}]}]}} 2021-02-10T23:51:36.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:36 gibba001 conmon[29242]: cluster 2021-02-10T23:51:35.355096+0000 mgr.x (mgr.14140) 359 : cluster [DBG] pgmap v269: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:37.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:37 gibba001 conmon[29242]: audit 2021-02-10T23:51:35.568720+0000 mgr.x (mgr.14140) 360 : audit [DBG] from='client.14474 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:38.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:38 gibba001 conmon[29242]: cluster 2021-02-10T23:51:37.355566+0000 mgr.x (mgr.14140) 361 : cluster [DBG] pgmap v270: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:39.215 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:39.360 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:40.673 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:40 gibba001 conmon[29242]: cluster 2021-02-10T23:51:39.355920+0000 mgr.x (mgr.14140) 362 : cluster [DBG] pgmap v271: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:40.917 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:40.918 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:41.508 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":271,"stamp":"2021-02-10T23:51:39.355725+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.379}]}]},{"osd":0,"up_from":8,"seq":34359738468,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.35699999999999998}]}]}]}} 2021-02-10T23:51:41.509 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:41.658 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:42.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:42 gibba001 conmon[29242]: audit 2021-02-10T23:51:40.918017+0000 mgr.x (mgr.14140) 363 : audit [DBG] from='client.14476 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:42.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:42 gibba001 conmon[29242]: cluster 2021-02-10T23:51:41.356238+0000 mgr.x (mgr.14140) 364 : cluster [DBG] pgmap v272: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:43.238 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:43.238 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":561,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:43.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:43 gibba001 conmon[29242]: audit 2021-02-10T23:51:43.239266+0000 mon.a (mon.0) 272 : audit [DBG] from='client.? 172.21.2.101:0/2178896678' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:43.858 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:43.858 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:44.002 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:44.493 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:44 gibba001 conmon[29242]: cluster 2021-02-10T23:51:43.356473+0000 mgr.x (mgr.14140) 365 : cluster [DBG] pgmap v273: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:45.569 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:45.570 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:46.191 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":274,"stamp":"2021-02-10T23:51:45.356551+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.35799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738469,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.35699999999999998}]}]}]}} 2021-02-10T23:51:46.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:46 gibba001 conmon[29242]: cluster 2021-02-10T23:51:45.356676+0000 mgr.x (mgr.14140) 366 : cluster [DBG] pgmap v274: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:47.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:47 gibba001 conmon[29242]: audit 2021-02-10T23:51:45.569507+0000 mgr.x (mgr.14140) 367 : audit [DBG] from='client.14480 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:48 gibba001 conmon[29242]: cluster 2021-02-10T23:51:47.357143+0000 mgr.x (mgr.14140) 368 : cluster [DBG] pgmap v275: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:49.192 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:49.339 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:50 gibba001 conmon[29242]: cluster 2021-02-10T23:51:49.357379+0000 mgr.x (mgr.14140) 369 : cluster [DBG] pgmap v276: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:50.809 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:50.810 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:51.460 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":276,"stamp":"2021-02-10T23:51:49.357257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574945,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.35799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738470,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.438}]}]}]}} 2021-02-10T23:51:51.462 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:51:51.607 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:52.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:52 gibba001 conmon[29242]: audit 2021-02-10T23:51:50.809187+0000 mgr.x (mgr.14140) 370 : audit [DBG] from='client.14482 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:52.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:52 gibba001 conmon[29242]: cluster 2021-02-10T23:51:51.358051+0000 mgr.x (mgr.14140) 371 : cluster [DBG] pgmap v277: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:53.218 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:53.219 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":571,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:51:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:53 gibba001 conmon[29242]: audit 2021-02-10T23:51:53.219829+0000 mon.a (mon.0) 273 : audit [DBG] from='client.? 172.21.2.101:0/627505670' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:51:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:53 gibba001 conmon[29242]: audit 2021-02-10T23:51:53.366423+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:51:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:53 gibba001 conmon[29242]: audit 2021-02-10T23:51:53.366590+0000 mon.a (mon.0 2021-02-10T23:51:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:53 gibba001 conmon[29242]: ) 275 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:51:53.710 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:51:53 gibba001 conmon[29628]: debug 2021-02-10T23:51:53.262+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:51:53.812 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:51:53.812 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:53.960 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:51:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:54 gibba001 conmon[29242]: cluster 2021-02-10T23:51:53.358439+0000 mgr.x (mgr.14140) 372 : cluster [DBG] pgmap v278: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:55.460 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:51:55.461 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:51:56.066 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2021-02-10T23:51:55.358552+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.376}]}]},{"osd":0,"up_from":8,"seq":34359738471,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.378}]}]}]}} 2021-02-10T23:51:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:56 gibba001 conmon[29242]: cluster 2021-02-10T23:51:55.358705+0000 mgr.x (mgr.14140) 373 : cluster [DBG] pgmap v279: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:56 gibba001 conmon[29242]: audit 2021-02-10T23:51:55.460891+0000 mgr.x (mgr.14140) 374 : audit [DBG] from='client.14486 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:51:58.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:51:57 gibba001 conmon[29242]: cluster 2021-02-10T23:51:57.359173+0000 mgr.x (mgr.14140) 375 : cluster [DBG] pgmap v280: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:51:59.068 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:51:59.214 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:00.661 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:00 gibba001 conmon[29242]: cluster 2021-02-10T23:51:59.359744+0000 mgr.x (mgr.14140) 376 : cluster [DBG] pgmap v281: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:00.867 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:00.868 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:01.510 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":281,"stamp":"2021-02-10T23:51:59.359630+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574947,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:50:59 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.40899999999999997,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.67200000000000004,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.44800000000000001,"15min":0.45300000000000001},"min":{"1min":0.32700000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.376}]}]},{"osd":0,"up_from":8,"seq":34359738472,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.38800000000000001},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.443}]}]}]}} 2021-02-10T23:52:01.511 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:01.658 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:02.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:02 gibba001 conmon[29242]: audit 2021-02-10T23:52:00.867931+0000 mgr.x (mgr.14140) 377 : audit [DBG] from='client.14488 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:02.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:02 gibba001 conmon[29242]: cluster 2021-02-10T23:52:01.360395+0000 mgr.x (mgr.14140) 378 : cluster [DBG] pgmap v282: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:03.326 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:03.326 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":581,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:03.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:03 gibba001 conmon[29242]: audit 2021-02-10T23:52:03.326977+0000 mon.a (mon.0) 276 : audit [DBG] from='client.? 172.21.2.101:0/2924042732' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:03.933 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:03.933 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:04.086 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:04.623 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:04 gibba001 conmon[29242]: cluster 2021-02-10T23:52:03.360925+0000 mgr.x (mgr.14140) 379 : cluster [DBG] 2021-02-10T23:52:04.623 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:04 gibba001 conmon[29242]: pgmap v283: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:05.684 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:05.685 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:06.363 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":284,"stamp":"2021-02-10T23:52:05.361071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.503}]}]},{"osd":0,"up_from":8,"seq":34359738473,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.379}]}]}]}} 2021-02-10T23:52:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:06 gibba001 conmon[29242]: cluster 2021-02-10T23:52:05.361202+0000 mgr.x (mgr.14140) 380 : cluster [DBG] pgmap v284: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:07.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:07 gibba001 conmon[29242]: audit 2021-02-10T23:52:05.684419+0000 mgr.x (mgr.14140) 381 : audit [DBG] from='client.14492 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:08.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:08 gibba001 conmon[29242]: cluster 2021-02-10T23:52:07.361922+0000 mgr.x (mgr.14140) 382 : cluster [DBG] pgmap v285: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:09.365 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:09.644 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:10.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:10 gibba001 conmon[29242]: cluster 2021-02-10T23:52:09.362648+0000 mgr.x (mgr.14140) 383 : cluster [DBG] pgmap v286: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:11.185 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:11.186 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:11.793 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2021-02-10T23:52:09.362510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574949,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.503}]}]},{"osd":0,"up_from":8,"seq":34359738474,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:51:05 2021","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.41199999999999998,"15min":0.45300000000000001},"min":{"1min":0.29799999999999999,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53900000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.443},{"interface":"front","average":{"1min":0.441,"5min":0.434,"15min":0.45700000000000002},"min":{"1min":0.34300000000000003,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.40400000000000003}]}]}]}} 2021-02-10T23:52:11.793 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:11.940 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:12.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:12 gibba001 conmon[29242]: audit 2021-02-10T23:52:11.185905+0000 mgr.x (mgr.14140) 384 : audit [DBG] from='client.14494 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:12.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:12 gibba001 conmon[29242]: cluster 2021-02-10T23:52:11.363065+0000 mgr.x (mgr.14140) 385 : cluster [DBG] pgmap v287: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:13.546 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:13.547 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":591,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:14.167 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:14.167 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:14.310 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:14 gibba001 conmon[29242]: cluster 2021-02-10T23:52:13.363294+0000 mgr.x (mgr.14140) 386 : cluster [DBG] pgmap v288: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:14 gibba001 conmon[29242]: audit 2021-02-10T23:52:13.547632+0000 mon.a (mon.0) 277 : audit [DBG] from='client.? 172.21.2.101:0/135605558' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:15.974 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:15.975 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:16.702 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:16 gibba001 conmon[29242]: cluster 2021-02-10T23:52:15.363575+0000 mgr.x (mgr.14140) 387 : cluster [DBG] pgmap v289: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:16.716 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2021-02-10T23:52:15.363420+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574951,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.32900000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738475,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.375},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.39300000000000002}]}]}]}} 2021-02-10T23:52:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:17 gibba001 conmon[29242]: audit 2021-02-10T23:52:15.974768+0000 mgr.x (mgr.14140) 388 : audit [DBG] from='client.14498 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:18.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:18 gibba001 conmon[29242]: cluster 2021-02-10T23:52:17.364268+0000 mgr.x (mgr.14140) 389 : cluster [DBG] pgmap v290: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:19.717 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:19.863 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:20.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:20 gibba001 conmon[29242]: cluster 2021-02-10T23:52:19.364993+0000 mgr.x (mgr.14140) 390 : cluster [DBG] pgmap v291: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:21.444 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:21.802 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:22.124 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":292,"stamp":"2021-02-10T23:52:21.365133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574952,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.439}]}]},{"osd":0,"up_from":8,"seq":34359738476,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.47299999999999998}]}]}]}} 2021-02-10T23:52:22.125 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:22.275 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:22 gibba001 conmon[29242]: cluster 2021-02-10T23:52:21.365246+0000 mgr.x (mgr.14140) 391 : cluster [DBG] pgmap v292: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:22.788 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:22 gibba001 conmon[29242]: audit 2021-02-10T23:52:21.445058+0000 mgr.x (mgr.14140) 392 : audit [DBG] from='client.14500 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:23.919 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:23.919 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":602,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:24.496 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:24.496 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:24.642 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:24 gibba001 conmon[29242]: cluster 2021-02-10T23:52:23.365461+0000 mgr.x (mgr.14140) 393 : cluster [DBG] pgmap v293: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:24 gibba001 conmon[29242]: audit 2021-02-10T23:52:23.920366+0000 mon.a (mon.0) 278 : audit [DBG] from='client.? 172.21.2.101:0/3151549502' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:26.211 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:26.212 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:26 gibba001 conmon[29242]: cluster 2021-02-10T23:52:25.365853+0000 mgr.x (mgr.14140) 394 : cluster [DBG] pgmap v294: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:26.833 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":294,"stamp":"2021-02-10T23:52:25.365735+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574953,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.68600000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738477,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.47299999999999998}]}]}]}} 2021-02-10T23:52:27.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:27 gibba001 conmon[29242]: audit 2021-02-10T23:52:26.209760+0000 mgr.x (mgr.14140) 395 : audit [DBG] from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:28.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:28 gibba001 conmon[29242]: cluster 2021-02-10T23:52:27.366570+0000 mgr.x (mgr.14140) 396 : cluster [DBG] pgmap v295: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:29.835 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:29.981 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:30 gibba001 conmon[29242]: cluster 2021-02-10T23:52:29.367208+0000 mgr.x (mgr.14140) 397 : cluster [DBG] pgmap v296: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:31.484 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:31.485 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:32.038 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2021-02-10T23:52:31.367354+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574954,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.39300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738478,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.46500000000000002}]}]}]}} 2021-02-10T23:52:32.039 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:32.187 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:32.648 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:32 gibba001 conmon[29242]: cluster 2021-02-10T23:52:31.367474+0000 mgr.x (mgr.14140) 398 : cluster [DBG] pgmap v297: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:32.741 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:32 gibba001 conmon[29242]: audit 2021-02-10T23:52:31.484387+0000 mgr.x (mgr.14140) 399 : audit [DBG] from='client.14506 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:33.728 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:33.756 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":612,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:34.305 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:34.305 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:34.456 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:34.689 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:34 gibba001 conmon[29242]: cluster 2021-02-10T23:52:33.367868+0000 mgr.x (mgr.14140) 400 : cluster [DBG] pgmap v298: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:34.753 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:34 gibba001 conmon[29242]: audit 2021-02-10T23:52:33.729107+0000 mon.a (mon.0) 279 : audit [DBG] from='client.? 172.21.2.101:0/1597128704' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:36.034 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:36.035 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:36.673 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":299,"stamp":"2021-02-10T23:52:35.368290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.438}]}]},{"osd":0,"up_from":8,"seq":34359738479,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.46500000000000002}]}]}]}} 2021-02-10T23:52:36.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:36 gibba001 conmon[29242]: cluster 2021-02-10T23:52:35.368439+0000 mgr.x (mgr.14140) 401 : cluster [DBG] pgmap v299: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:37.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:37 gibba001 conmon[29242]: audit 2021-02-10T23:52:36.034428+0000 mgr.x (mgr.14140) 402 : audit [DBG] from='client.14510 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:38.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:38 gibba001 conmon[29242]: cluster 2021-02-10T23:52:37.369063+0000 mgr.x (mgr.14140) 403 : cluster [DBG] pgmap v300: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:39.675 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:39.823 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:40.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:40 gibba001 conmon[29242]: cluster 2021-02-10T23:52:39.369713+0000 mgr.x (mgr.14140) 404 : cluster [DBG] pgmap v301: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:41.344 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:41.345 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:42.043 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2021-02-10T23:52:39.369572+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.438}]}]},{"osd":0,"up_from":8,"seq":34359738480,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.52900000000000003}]}]}]}} 2021-02-10T23:52:42.044 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:42.188 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:42.666 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:42 gibba001 conmon[29242]: audit 2021-02-10T23:52:41.344483+0000 mgr.x (mgr.14140) 405 : audit [DBG] from='client.14512 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:42.667 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:42 gibba001 conmon[29242]: cluster 2021-02-10T23:52:41.370028+0000 mgr.x (mgr.14140) 406 : cluster [DBG] pgmap v302: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:43.731 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:43.731 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":622,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:44.374 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:44.457 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:44.603 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:44.713 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:44 gibba001 conmon[29242]: cluster 2021-02-10T23:52:43.370509+0000 mgr.x (mgr.14140) 407 : cluster [DBG] pgmap v303: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:44.713 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:44 gibba001 conmon[29242]: audit 2021-02-10T23:52:43.732333+0000 mon.a (mon.0) 280 : audit [DBG] from='client.? 172.21.2.101:0/2019248961' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:46.110 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:46.111 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:46.682 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":304,"stamp":"2021-02-10T23:52:45.370892+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574957,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738481,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.46700000000000003}]}]}]}} 2021-02-10T23:52:46.820 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:46 gibba001 conmon[29242]: cluster 2021-02-10T23:52:45.371014+0000 mgr.x (mgr.14140) 408 : cluster [DBG] pgmap v304: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:47.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:47 gibba001 conmon[29242]: audit 2021-02-10T23:52:46.110883+0000 mgr.x (mgr.14140) 409 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:48 gibba001 conmon[29242]: cluster 2021-02-10T23:52:47.371713+0000 mgr.x (mgr.14140) 410 : cluster [DBG] pgmap v305: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:49.820 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:49.966 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:50.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:50 gibba001 conmon[29242]: cluster 2021-02-10T23:52:49.372366+0000 mgr.x (mgr.14140) 411 : cluster [DBG] pgmap v306: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:51.535 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:51.535 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:52.171 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2021-02-10T23:52:51.372509+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574958,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.41899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.433},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.375}]}]}]}} 2021-02-10T23:52:52.172 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:52:52.318 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:52.790 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:52 gibba001 conmon[29242]: cluster 2021-02-10T23:52:51.372633+0000 mgr.x (mgr.14140) 412 : cluster [DBG] pgmap v307: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:52.790 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:52 gibba001 conmon[29242]: audit 2021-02-10T23:52:51.535098+0000 mgr.x (mgr.14140) 413 : audit [DBG] from='client.14518 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:53.589 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:53 gibba001 conmon[29242]: audit 2021-02-10T23:52:53.368072+0000 mon.a (mon.0) 281 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:52:53.589 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:53 gibba001 conmon[29242]: audit 2021-02-10T23:52:53.368208+0000 mon.a (mon.0) 282 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:52:53.589 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:52:53 gibba001 conmon[29628]: debug 2021-02-10T23:52:53.263+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:52:53.875 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:53.875 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":632,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:52:54.463 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:52:54.463 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:54.610 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:52:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:54 gibba001 conmon[29242]: cluster 2021-02-10T23:52:53.372839+0000 mgr.x (mgr.14140) 414 : cluster [DBG] pgmap v308: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:54 gibba001 conmon[29242]: audit 2021-02-10T23:52:53.876623+0000 mon.a (mon.0) 283 : audit [DBG] from='client.? 172.21.2.101:0/1474963306' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:52:56.201 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:52:56.202 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:52:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:56 gibba001 conmon[29242]: cluster 2021-02-10T23:52:55.373418+0000 mgr.x (mgr.14140) 415 : cluster [DBG] pgmap v309: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:56.809 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":309,"stamp":"2021-02-10T23:52:55.373297+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574959,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.36599999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738483,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.502},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.48399999999999999}]}]}]}} 2021-02-10T23:52:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:57 gibba001 conmon[29242]: audit 2021-02-10T23:52:56.200937+0000 mgr.x (mgr.14140) 416 : audit [DBG] from='client.14522 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:52:58.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:52:58 gibba001 conmon[29242]: cluster 2021-02-10T23:52:57.374069+0000 mgr.x (mgr.14140) 417 : cluster [DBG] pgmap v310: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:52:59.811 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:52:59.959 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:00.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:00 gibba001 conmon[29242]: cluster 2021-02-10T23:52:59.374750+0000 mgr.x (mgr.14140) 418 : cluster [DBG] pgmap v311: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:01.600 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:01.601 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:02.219 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":312,"stamp":"2021-02-10T23:53:01.375163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574960,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.54300000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738484,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.40899999999999997}]}]}]}} 2021-02-10T23:53:02.221 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:02.371 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:02.615 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:02 gibba001 conmon[29242]: cluster 2021-02-10T23:53:01.375285+0000 mgr.x (mgr.14140) 419 : cluster [DBG] pgmap v312: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:03.738 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:03 gibba001 conmon[29242]: audit 2021-02-10T23:53:01.600815+0000 mgr.x (mgr.14140) 420 : audit [DBG] from='client.14524 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:04.026 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:04.026 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":642,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:53:04.671 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:53:04.672 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:04.816 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:04.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:04 gibba001 conmon[29242]: cluster 2021-02-10T23:53:03.375562+0000 mgr.x (mgr.14140) 421 : cluster [DBG] pgmap v313: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:04.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:04 gibba001 conmon[29242]: 2021-02-10T23:53:04.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:04 gibba001 conmon[29242]: audit 2021-02-10T23:53:04.027151+0000 mon.a (mon.0) 284 : audit [DBG] from='client.? 172.21.2.101:0/1706104431' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:53:06.386 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:06.387 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:06.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:06 gibba001 conmon[29242]: cluster 2021-02-10T23:53:05.375835+0000 mgr.x (mgr.14140) 422 : cluster [DBG] pgmap v314: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:07.040 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2021-02-10T23:53:05.375712+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:52:03 2021","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.44500000000000001,"15min":0.44400000000000001},"min":{"1min":0.33800000000000002,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.57299999999999995,"5min":0.67200000000000004,"15min":0.67200000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.44700000000000001,"15min":0.45100000000000001},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.53600000000000003,"5min":0.60799999999999998,"15min":0.61599999999999999},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359738485,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:52:08 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.41899999999999998,"15min":0.45000000000000001},"min":{"1min":0.33200000000000002,"5min":0.28000000000000003,"15min":0.27700000000000002},"max":{"1min":0.53300000000000003,"5min":0.57699999999999996,"15min":0.66100000000000003},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.433,"15min":0.45400000000000001},"min":{"1min":0.32300000000000001,"5min":0.30299999999999999,"15min":0.28699999999999998},"max":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.39000000000000001}]}]}]}} 2021-02-10T23:53:07.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:07 gibba001 conmon[29242]: audit 2021-02-10T23:53:06.386306+0000 mgr.x (mgr.14140) 423 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:08.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:08 gibba001 conmon[29242]: cluster 2021-02-10T23:53:07.376722+0000 mgr.x (mgr.14140) 424 : cluster [DBG] pgmap v315: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:12.156 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:12.156 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:10 gibba001 conmon[29242]: cluster 2021-02-10T23:53:09.377400+0000 mgr.x (mgr.14140) 425 : cluster [DBG] pgmap v316: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:12.302 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:12.818 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:12 gibba001 conmon[29242]: cluster 2021-02-10T23:53:11.378061+0000 mgr.x (mgr.14140) 426 : cluster [DBG] pgmap v317: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:13.894 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:13.895 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:14.525 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":318,"stamp":"2021-02-10T23:53:13.378322+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.497},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.55700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738487,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.45500000000000002}]}]}]}} 2021-02-10T23:53:14.526 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:14.674 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:14.929 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:14 gibba001 conmon[29242]: cluster 2021-02-10T23:53:13.378437+0000 mgr.x (mgr.14140) 427 : cluster [DBG] pgmap v318: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:15.819 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:15 gibba001 conmon[29242]: audit 2021-02-10T23:53:13.894324+0000 mgr.x (mgr.14140) 428 : audit [DBG] from='client.14530 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:16.320 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:16.321 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":654,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:53:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:16 gibba001 conmon[29242]: cluster 2021-02-10T23:53:15.378886+0000 mgr.x (mgr.14140) 429 : cluster [DBG] pgmap v319: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:16 gibba001 conmon[29242]: audit 2021-02-10T23:53:16.321848+0000 mon.a (mon.0) 285 : audit [DBG] from='client.? 172.21.2.101:0/1413224922' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:53:16.924 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:53:16.924 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:17.074 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:17.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:17 gibba001 conmon[29242]: cluster 2021-02-10T23:53:17.379132+0000 mgr.x (mgr.14140) 430 : cluster [DBG] pgmap v320: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:18.602 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:19.742 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:19.742 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":320,"stamp":"2021-02-10T23:53:17.379020+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574963,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738488,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.59699999999999998}]}]}]}} 2021-02-10T23:53:20.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:20 gibba001 conmon[29242]: audit 2021-02-10T23:53:18.602617+0000 mgr.x (mgr.14140) 431 : audit [DBG] from='client.14534 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:20.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:20 gibba001 conmon[29242]: cluster 2021-02-10T23:53:19.379576+0000 mgr.x (mgr.14140) 432 : cluster [DBG] pgmap v321: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:22 gibba001 conmon[29242]: cluster 2021-02-10T23:53:21.379893+0000 mgr.x (mgr.14140) 433 : cluster [DBG] pgmap v322: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:22.744 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:22.899 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:24.512 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:24.513 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:24 gibba001 conmon[29242]: cluster 2021-02-10T23:53:23.380319+0000 mgr.x (mgr.14140) 434 : cluster [DBG] pgmap v323: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:25.141 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":323,"stamp":"2021-02-10T23:53:23.380184+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574964,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.372},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.437}]}]},{"osd":0,"up_from":8,"seq":34359738489,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.41599999999999998}]}]}]}} 2021-02-10T23:53:25.142 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:25.287 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:25.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:25 gibba001 conmon[29242]: audit 2021-02-10T23:53:24.512475+0000 mgr.x (mgr.14140) 435 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:26 gibba001 conmon[29242]: cluster 2021-02-10T23:53:25.381047+0000 mgr.x (mgr.14140) 436 : cluster [DBG] 2021-02-10T23:53:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:26 gibba001 conmon[29242]: pgmap v324: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:26.793 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:26.794 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":665,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:53:27.353 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:53:27.354 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:27.498 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:28.003 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:27 gibba001 conmon[29242]: audit 2021-02-10T23:53:26.794664+0000 mon.a (mon.0) 286 : audit [DBG] from='client.? 172.21.2.101:0/966956665' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:53:28.003 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:27 gibba001 conmon[29242]: cluster 2021-02-10T23:53:27.381329+0000 mgr.x (mgr.14140) 437 : cluster [DBG] pgmap v325: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:29.093 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:29.094 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:29.724 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":325,"stamp":"2021-02-10T23:53:27.381209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574965,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.35799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738490,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.371}]}]}]}} 2021-02-10T23:53:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:30 gibba001 conmon[29242]: audit 2021-02-10T23:53:29.093630+0000 mgr.x (mgr.14140) 438 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:30 gibba001 conmon[29242]: cluster 2021-02-10T23:53:29.381571+0000 mgr.x (mgr.14140) 439 : cluster [DBG] pgmap v326: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:32.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:32 gibba001 conmon[29242]: cluster 2021-02-10T23:53:31.382270+0000 mgr.x (mgr.14140) 440 : cluster [DBG] pgmap v327: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:32.726 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:32.870 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:34.340 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:34.340 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:34.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:34 gibba001 conmon[29242]: cluster 2021-02-10T23:53:33.382513+0000 mgr.x (mgr.14140) 441 : cluster [DBG] pgmap v328: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:34.907 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":328,"stamp":"2021-02-10T23:53:33.382399+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574966,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738491,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.46500000000000002}]}]}]}} 2021-02-10T23:53:34.908 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:35.056 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:35.505 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:35 gibba001 conmon[29242]: audit 2021-02-10T23:53:34.337477+0000 mgr.x (mgr.14140) 442 : audit [DBG] from='client.14542 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:36.595 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:36.595 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":674,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:53:36.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:36 gibba001 conmon[29242]: cluster 2021-02-10T23:53:35.382773+0000 mgr.x (mgr.14140) 443 : cluster [DBG] pgmap v329: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:37.182 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:53:37.183 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:37.330 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:37.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:37 gibba001 conmon[29242]: audit 2021-02-10T23:53:36.596287+0000 mon.a (mon.0) 287 : audit [DBG] from='client.? 172.21.2.101:0/3170250561' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:53:38.701 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:38 gibba001 conmon[29242]: cluster 2021-02-10T23:53:37.383276+0000 mgr.x (mgr.14140 2021-02-10T23:53:38.701 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:38 gibba001 conmon[29242]: ) 444 : cluster [DBG] pgmap v330: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:38.911 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:38.912 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:39.529 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":330,"stamp":"2021-02-10T23:53:37.383163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738492,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.44800000000000001}]}]}]}} 2021-02-10T23:53:40.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:40 gibba001 conmon[29242]: audit 2021-02-10T23:53:38.911620+0000 mgr.x (mgr.14140) 445 : audit [DBG] from='client.14546 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:40.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:40 gibba001 conmon[29242]: cluster 2021-02-10T23:53:39.383897+0000 mgr.x (mgr.14140) 446 : cluster [DBG] pgmap v331: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:42.531 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:42.677 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:43.686 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:42 gibba001 conmon[29242]: cluster 2021-02-10T23:53:41.384536+0000 mgr.x (mgr.14140) 447 : cluster [DBG] pgmap v332: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:44.283 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:44.412 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:44.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:44 gibba001 conmon[29242]: cluster 2021-02-10T23:53:43.384955+0000 mgr.x (mgr.14140) 448 : cluster [DBG] pgmap v333: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:44.884 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":333,"stamp":"2021-02-10T23:53:43.384837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42299999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738493,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.48899999999999999}]}]}]}} 2021-02-10T23:53:44.885 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:45.037 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:45.554 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:45 gibba001 conmon[29242]: audit 2021-02-10T23:53:44.282603+0000 mgr.x (mgr.14140) 449 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:46.684 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:46.684 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":685,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:53:46.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:46 gibba001 conmon[29242]: cluster 2021-02-10T23:53:45.385245+0000 mgr.x (mgr.14140) 450 : cluster [DBG] pgmap v334: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:47.310 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:53:47.310 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:47.458 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:47.655 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:47 gibba001 conmon[29242]: audit 2021-02-10T23:53:46.678821+0000 mon.a (mon.0) 288 : audit [DBG] from='client.? 172.21.2.101:0/3421223247' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:53:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:48 gibba001 conmon[29242]: cluster 2021-02-10T23:53:47.385691+0000 mgr.x (mgr.14140) 451 : cluster [DBG] pgmap v335: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:48 gibba001 conmon[29242]: audit 2021-02-10T23:53:48.270304+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:53:48.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:48 gibba001 conmon[29242]: audit 2021-02-10T23:53:48.271026+0000 mon.a (mon.0) 290 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-10T23:53:49.070 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:53.218 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:53.219 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":335,"stamp":"2021-02-10T23:53:47.385575+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574969,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.504}]}]},{"osd":0,"up_from":8,"seq":34359738494,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.47999999999999998}]}]}]}} 2021-02-10T23:53:53.219 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:50 gibba001 conmon[29242]: audit 2021-02-10T23:53:49.069076+0000 mgr.x (mgr.14140) 452 : audit [DBG] from='client.14552 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:53:53.219 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:50 gibba001 conmon[29242]: cluster 2021-02-10T23:53:49.386160+0000 mgr.x (mgr.14140) 453 : cluster [DBG] pgmap v336: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:53.219 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:50 gibba001 conmon[29242]: audit 2021-02-10T23:53:49.792976+0000 mon.a (mon.0) 291 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:53:53.220 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:50 gibba001 conmon[29242]: audit 2021-02-10T23:53:50.028676+0000 mon.a (mon.0) 292 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-10T23:53:53.220 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:51 gibba001 conmon[29242]: cephadm 2021-02-10T23:53:49.793370+0000 mgr.x (mgr.14140) 454 : cephadm [INF] Refreshing gibba001 facts 2021-02-10T23:53:53.220 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:52 gibba001 conmon[29242]: cluster 2021-02-10T23:53:51.386966+0000 mgr.x (mgr.14140) 455 : cluster [DBG] pgmap v337: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:53 gibba001 conmon[29242]: audit 2021-02-10T23:53:53.370303+0000 mon.a (mon.0) 293 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:53:53.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:53 gibba001 conmon[29242]: audit 2021-02-10T23:53:53.370475+0000 mon.a (mon.0) 294 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:53:53.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:53:53 gibba001 conmon[29628]: debug 2021-02-10T23:53:53.264+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:53:54.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:54 gibba001 conmon[29242]: cluster 2021-02-10T23:53:53.387349+0000 mgr.x (mgr.14140) 456 : cluster [DBG] pgmap v338: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:56.221 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:53:56.367 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:56.572 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:56 gibba001 conmon[29242]: cluster 2021-02-10T23:53:55.387707+0000 mgr.x (mgr.14140) 457 : cluster [DBG] pgmap v339: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:57 gibba001 conmon[29242]: cluster 2021-02-10T23:53:57.388201+0000 mgr.x (mgr.14140) 458 : cluster [DBG] pgmap v340: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:53:57.976 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:53:57.977 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:53:58.548 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":340,"stamp":"2021-02-10T23:53:57.388078+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574971,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.43099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.54300000000000004}]}]}]}} 2021-02-10T23:53:58.549 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:53:58.692 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:53:58.921 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:58 gibba001 conmon[29242]: audit 2021-02-10T23:53:57.976286+0000 mgr.x (mgr.14140) 459 : audit [DBG] from='client.14554 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:00.056 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:53:59 gibba001 conmon[29242]: cluster 2021-02-10T23:53:59.388657+0000 mgr.x (mgr.14140) 460 : cluster [DBG] pgmap v341: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:00.312 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:00.312 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":698,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:54:00.922 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:54:00.922 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:01.072 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:01.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:00 gibba001 conmon[29242]: audit 2021-02-10T23:54:00.312883+0000 mon.a (mon.0) 295 : audit [DBG] from='client.? 172.21.2.101:0/654603128' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:54:01.866 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:01 gibba001 conmon[29242]: cluster 2021-02-10T23:54:01.388855+0000 mgr.x (mgr.14140) 461 : cluster [DBG] pgmap v342: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:02.723 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:02.724 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:03.337 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":342,"stamp":"2021-02-10T23:54:01.388741+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574972,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.38200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.54300000000000004}]}]}]}} 2021-02-10T23:54:04.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:04 gibba001 conmon[29242]: audit 2021-02-10T23:54:02.723663+0000 mgr.x (mgr.14140) 462 : audit [DBG] from='client.14558 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:04.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:04 gibba001 conmon[29242]: cluster 2021-02-10T 2021-02-10T23:54:04.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:04 gibba001 conmon[29242]: 23:54:03.389459+0000 mgr.x (mgr.14140) 463 : cluster [DBG] pgmap v343: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:06.339 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:06.487 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:06.663 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:06 gibba001 conmon[29242]: cluster 2021-02-10T23:54:05.389974+0000 mgr.x (mgr.14140) 464 : cluster [DBG] pgmap v344: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:07.959 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:07.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:07 gibba001 conmon[29242]: cluster 2021-02-10T23:54:07.390661+0000 mgr.x (mgr.14140) 465 : cluster [DBG] pgmap v345: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:07.960 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:08.631 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2021-02-10T23:54:07.390510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574973,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:53:07 2021","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.45300000000000001,"15min":0.44500000000000001},"min":{"1min":0.375,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.45100000000000001,"15min":0.45200000000000001},"min":{"1min":0.32900000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738498,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:53:09 2021","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.42499999999999999,"15min":0.44700000000000001},"min":{"1min":0.33500000000000002,"5min":0.29099999999999998,"15min":0.27700000000000002},"max":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.66100000000000003},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.443,"15min":0.45300000000000001},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.53000000000000003,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.48199999999999998}]}]}]}} 2021-02-10T23:54:12.000 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:54:12.001 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:08 gibba001 conmon[29242]: audit 2021-02-10T23:54:07.959059+0000 mgr.x (mgr.14140) 466 : audit [DBG] from='client.14560 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:12.001 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:09 gibba001 conmon[29242]: cluster 2021-02-10T23:54:09.391346+0000 mgr.x (mgr.14140) 467 : cluster [DBG] pgmap v346: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:12.146 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:12.678 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:12 gibba001 conmon[29242]: cluster 2021-02-10T23:54:11.392076+0000 mgr.x (mgr.14140) 468 : cluster [DBG] 2021-02-10T23:54:12.679 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:12 gibba001 conmon[29242]: pgmap v347: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:13.768 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:13.768 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":712,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:54:14.415 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:54:14.415 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:14.565 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:14 gibba001 conmon[29242]: cluster 2021-02-10T23:54:13.392293+0000 mgr.x (mgr.14140) 469 : cluster [DBG] pgmap v348: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:14 gibba001 conmon[29242]: audit 2021-02-10T23:54:13.768757+0000 mon.a (mon.0) 296 : audit [DBG] from='client.? 172.21.2.101:0/3376162327' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:54:16.226 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:16.227 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:16 gibba001 conmon[29242]: cluster 2021-02-10T23:54:15.392825+0000 mgr.x (mgr.14140) 470 : cluster [DBG] pgmap v349: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:16.855 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":349,"stamp":"2021-02-10T23:54:15.392702+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574975,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738499,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.34100000000000003}]}]}]}} 2021-02-10T23:54:17.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:17 gibba001 conmon[29242]: audit 2021-02-10T23:54:16.225936+0000 mgr.x (mgr.14140) 471 : audit [DBG] from='client.14564 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:20.926 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:20.927 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:18 gibba001 conmon[29242]: cluster 2021-02-10T23:54:17.393511+0000 mgr.x (mgr.14140) 472 : cluster [DBG] pgmap v350: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:20.927 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:20 gibba001 conmon[29242]: cluster 2021-02-10T23:54:19.394178+0000 mgr.x (mgr.14140) 473 : cluster [DBG] pgmap v351: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:21.071 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:22.560 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:22.561 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:22 gibba001 conmon[29242]: cluster 2021-02-10T23:54:21.394405+0000 mgr.x (mgr.14140) 474 : cluster [DBG] pgmap v352: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:23.175 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":352,"stamp":"2021-02-10T23:54:21.394290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574976,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.501},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738500,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.45600000000000002}]}]}]}} 2021-02-10T23:54:23.176 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:54:23.320 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:23.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:23 gibba001 conmon[29242]: audit 2021-02-10T23:54:22.560437+0000 mgr.x (mgr.14140) 475 : audit [DBG] from='client.14566 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:24.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:24 gibba001 conmon[29242]: cluster 2021-02-10T23:54:23.394694+0000 mgr.x (mgr.14140) 476 : cluster [DBG] pgmap v353: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:24.902 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:24.902 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":723,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:54:25.524 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:54:25.525 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:25.674 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:25.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:25 gibba001 conmon[29242]: audit 2021-02-10T23:54:24.903329+0000 mon.a (mon.0) 297 : audit [DBG] from='client.? 172.21.2.101:0/1346015669' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:54:26.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:26 gibba001 conmon[29242]: cluster 2021-02-10T23:54:25.395439+0000 mgr.x (mgr.14140) 477 : cluster [DBG] pgmap v354: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:27.295 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:27.296 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:27.912 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2021-02-10T23:54:25.395290+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.442}]}]},{"osd":0,"up_from":8,"seq":34359738501,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.39300000000000002}]}]}]}} 2021-02-10T23:54:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:27 gibba001 conmon[29242]: audit 2021-02-10T23:54:27.295386+0000 mgr.x (mgr.14140) 478 : audit [DBG] from='client.14570 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:27 gibba001 conmon[29242]: cluster 2021-02-10T23:54:27.395685+0000 mgr.x (mgr.14140) 479 : cluster [DBG] pgmap v355: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:30 gibba001 conmon[29242]: cluster 2021-02-10T23:54:29.396292+0000 mgr.x (mgr.14140) 480 : cluster [DBG] pgmap v356: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:30.914 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:31.062 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:38.023 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:38.023 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":357,"stamp":"2021-02-10T23:54:31.396422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574978,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.51900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738502,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.438},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.378}]}]}]}} 2021-02-10T23:54:38.023 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:38.024 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:32 gibba001 conmon[29242]: cluster 2021-02-10T23:54:31.396547+0000 mgr.x (mgr.14140) 481 : cluster [DBG] pgmap v357: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:38.024 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:33 gibba001 conmon[29242]: audit 2021-02-10T23:54:32.569436+0000 mgr.x (mgr.14140) 482 : audit [DBG] from='client.14572 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:38.024 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:34 gibba001 conmon[29242]: cluster 2021-02-10T23:54:33.397029+0000 mgr.x (mgr.14140) 483 : cluster [DBG] pgmap v358: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:38.024 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:36 gibba001 conmon[29242]: cluster 2021-02-10T23:54:35.397500+0000 mgr.x (mgr.14140) 484 : cluster [DBG] pgmap v359: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:38.025 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:54:38.044 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:37 gibba001 conmon[29242]: cluster 2021-02-10T23:54:37.398006+0000 mgr.x (mgr.14140) 485 : cluster [DBG] pgmap v360: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:38.171 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:39.827 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:40.748 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":738,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:54:40.749 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:40 gibba001 conmon[29242]: cluster 2021-02-10T23:54:39.398236+0000 mgr.x (mgr.14140) 486 : cluster [DBG] pgmap v361: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:40.749 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:40 gibba001 conmon[29242]: audit 2021-02-10T23:54:39.828277+0000 mon.a (mon.0) 298 : audit [DBG] from='client.? 172.21.2.101:0/1357827000' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:54:40.749 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:54:40.750 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:40.937 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:42.585 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:42.919 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:42.919 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:42 gibba001 conmon[29242]: cluster 2021-02-10T23:54:41.398482+0000 mgr.x (mgr.14140) 487 : cluster [DBG] pgmap v362: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:43.296 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2021-02-10T23:54:41.398365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574980,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.378}]}]},{"osd":0,"up_from":8,"seq":34359738504,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.42399999999999999}]}]}]}} 2021-02-10T23:54:43.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:43 gibba001 conmon[29242]: audit 2021-02-10T23:54:42.585309+0000 mgr.x (mgr.14140) 488 : audit [DBG] from='client.14576 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:44.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:44 gibba001 conmon[29242]: cluster 2021-02-10T23:54:43.398845+0000 mgr.x (mgr.14140) 489 : cluster [DBG] pgmap v363: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:46.298 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:46.447 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:46.646 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:46 gibba001 conmon[29242]: cluster 2021-02-10T23:54:45.399488+0000 mgr.x (mgr.14140) 490 : cluster [DBG] pgmap v364: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:46.647 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:46 gibba001 conmon[29242]: 2021-02-10T23:54:47.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:47 gibba001 conmon[29242]: cluster 2021-02-10T23:54:47.400221+0000 mgr.x (mgr.14140) 491 : cluster [DBG] pgmap v365: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:48.060 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:48.061 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:48.646 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":365,"stamp":"2021-02-10T23:54:47.400037+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574981,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738506,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.373},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.42199999999999999}]}]}]}} 2021-02-10T23:54:48.647 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:54:48.794 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:48.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:48 gibba001 conmon[29242]: audit 2021-02-10T23:54:48.060335+0000 mgr.x (mgr.14140) 492 : audit [DBG] from='client.14578 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:50.146 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:49 gibba001 conmon[29242]: cluster 2021-02-10T23:54:49.400475+0000 mgr.x (mgr.14140) 493 : cluster [DBG] pgmap v366: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:50.443 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:50.443 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":748,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:54:51.033 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:50 gibba001 conmon[29242]: audit 2021-02-10T23:54:50.444282+0000 mon.a (mon.0) 299 : audit [DBG] from='client.? 172.21.2.101:0/130304355' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:54:51.034 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:54:51.034 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:51.181 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:51.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:51 gibba001 conmon[29242]: cluster 2021-02-10T23:54:51.400876+0000 mgr.x (mgr.14140) 494 : cluster 2021-02-10T23:54:51.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:51 gibba001 conmon[29242]: [DBG] pgmap v367: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:52.767 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:52.768 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:53.410 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":367,"stamp":"2021-02-10T23:54:51.400755+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574982,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.443}]}]},{"osd":0,"up_from":8,"seq":34359738506,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.373},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.42199999999999999}]}]}]}} 2021-02-10T23:54:54.317 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:54:53 gibba001 conmon[29628]: debug 2021-02-10T23:54:53.265+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:54:54.317 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:53 gibba001 conmon[29242]: audit 2021-02-10T23:54:53.372636+0000 mon.a (mon.0) 300 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:54:54.317 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:53 gibba001 conmon[29242]: audit 2021-02-10T23 2021-02-10T23:54:54.317 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:53 gibba001 conmon[29242]: :54:53.372766+0000 mon.a (mon.0) 301 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:54:54.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:54 gibba001 conmon[29242]: audit 2021-02-10T23:54:52.767114+0000 mgr.x (mgr.14140) 495 : audit [DBG] from='client.14582 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:54:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:54 gibba001 conmon[29242]: cluster 2021-02-10T23:54:53.401168+0000 mgr.x (mgr.14140) 496 : cluster [DBG] pgmap v368: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:54 gibba001 conmon[29242]: 2021-02-10T23:54:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:56 gibba001 conmon[29242]: cluster 2021-02-10T23:54:55.401865+0000 mgr.x (mgr.14140) 497 : cluster [DBG] pgmap v369: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:57.317 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:54:57.471 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:54:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:54:57 gibba001 conmon[29242]: cluster 2021-02-10T23:54:57.402134+0000 mgr.x (mgr.14140) 498 : cluster [DBG] pgmap v370: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:54:59.018 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:54:59.019 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:54:59.642 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":370,"stamp":"2021-02-10T23:54:57.402007+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574983,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.41099999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738508,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.51700000000000002}]}]}]}} 2021-02-10T23:54:59.643 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:54:59.789 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:00.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:00 gibba001 conmon[29242]: audit 2021-02-10T23:54:59.018686+0000 mgr.x (mgr.14140) 499 : audit [DBG] from='client.14584 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:00.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:00 gibba001 conmon[29242]: cluster 2021-02-10T23:54:59.402622+0000 mgr.x (mgr.14140) 500 : cluster [DBG] pgmap v371: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:01.416 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:01.416 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":759,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:55:01.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:01 gibba001 conmon[29242]: audit 2021-02-10T23:55:01.416951+0000 mon.a (mon.0) 302 : audit [DBG] from='client.? 172.21.2.101:0/2536991231' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:55:02.108 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:55:09.130 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:09.131 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:02 gibba001 conmon[29242]: cluster 2021-02-10T23:55:01.402874+0000 mgr.x (mgr.14140) 501 : cluster [DBG] pgmap v372: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:09.131 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:04 gibba001 conmon[29242]: cluster 2021-02-10T23:55:03.403541+0000 mgr.x (mgr.14140) 502 : cluster [DBG] pgmap v373: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:09.131 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:06 gibba001 conmon[29242]: cluster 2021-02-10T23:55:05.404016+0000 mgr.x (mgr.14140) 503 : cluster [DBG] pgmap v374: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:09.131 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:07 gibba001 conmon[29242]: cluster 2021-02-10T23:55:07.404707+0000 mgr.x (mgr.14140) 504 : cluster [DBG] pgmap v375: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:09.278 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:10.657 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:10 gibba001 conmon[29242]: cluster 2021-02-10T23:55:09.405069+0000 mgr.x (mgr.14140) 505 : cluster [DBG] pgmap v376: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:10.866 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:10.867 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:11.500 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":376,"stamp":"2021-02-10T23:55:09.404939+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:54:08 2021","interfaces":[{"interface":"back","average":{"1min":0.40899999999999997,"5min":0.44400000000000001,"15min":0.443},"min":{"1min":0.34799999999999998,"5min":0.29799999999999999,"15min":0.26400000000000001},"max":{"1min":0.55800000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.45100000000000001,"5min":0.45000000000000001,"15min":0.45200000000000001},"min":{"1min":0.35799999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58699999999999997,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.434}]}]},{"osd":0,"up_from":8,"seq":34359738510,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:54:09 2021","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.439,"15min":0.44700000000000001},"min":{"1min":0.34899999999999998,"5min":0.29799999999999999,"15min":0.27700000000000002},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.66100000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44600000000000001,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.69999999999999996},"last":0.443}]}]}]}} 2021-02-10T23:55:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:12 gibba001 conmon[29242]: audit 2021-02-10T23:55:10.866287+0000 mgr.x (mgr.14140) 506 : audit [DBG] from='client.14588 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:13.594 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:12 gibba001 conmon[29242]: cluster 2021-02-10T23:55:11.405408+0000 mgr.x (mgr.14140) 507 : cluster [DBG] pgmap v377: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:14.502 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:15.208 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:14 gibba001 conmon[29242]: cluster 2021-02-10T23:55:13.406299+0000 mgr.x (mgr.14140) 508 : cluster [DBG] pgmap v378: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:15.355 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:16 gibba001 conmon[29242]: cluster 2021-02-10T23:55:15.406532+0000 mgr.x (mgr.14140) 509 : cluster [DBG] pgmap v379: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:16.883 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:16.885 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:17.493 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":379,"stamp":"2021-02-10T23:55:15.406413+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574987,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738511,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.45100000000000001}]}]}]}} 2021-02-10T23:55:17.494 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:55:17.639 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:18.085 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:17 gibba001 conmon[29242]: audit 2021-02-10T23:55:16.883814+0000 mgr.x (mgr.14140) 510 : audit [DBG] from='client.14590 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:18.085 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:17 gibba001 conmon[29242]: cluster 2021-02-10T23:55:17.406989+0000 mgr.x (mgr.14140) 511 : cluster [DBG] pgmap v380: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:19.152 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:19.152 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":777,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:55:19.460 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:19 gibba001 conmon[29242]: audit 2021-02-10T23:55:19.152988+0000 mon.a (mon.0) 303 : audit [DBG] from='client.? 172.21.2.101:0/3966807007' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:55:19.793 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:55:19.793 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:19.946 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:20.458 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:20 gibba001 conmon[29242]: cluster 2021-02-10T23:55:19.407435+0000 mgr.x (mgr.14140) 512 : cluster [DBG] pgmap v381: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:21.534 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:25.664 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:25.665 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":382,"stamp":"2021-02-10T23:55:21.407574+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574988,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.435},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.37}]}]},{"osd":0,"up_from":8,"seq":34359738512,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.379}]}]}]}} 2021-02-10T23:55:25.665 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:22 gibba001 conmon[29242]: cluster 2021-02-10T23:55:21.407692+0000 mgr.x (mgr.14140) 513 : cluster [DBG] pgmap v382: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:25.665 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:22 gibba001 conmon[29242]: audit 2021-02-10T23:55:21.533997+0000 mgr.x (mgr.14140) 514 : audit [DBG] from='client.14594 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:25.665 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:24 gibba001 conmon[29242]: cluster 2021-02-10T23:55:23.408414+0000 mgr.x (mgr.14140) 515 : cluster [DBG] pgmap v383: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:26.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:26 gibba001 conmon[29242]: cluster 2021-02-10T23:55:25.409013+0000 mgr.x (mgr.14140) 516 : cluster [DBG] pgmap v384: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:27 gibba001 conmon[29242]: cluster 2021-02-10T23:55:27.409707+0000 mgr.x (mgr.14140) 517 : cluster [DBG] pgmap v385: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:28.666 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:28.813 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:30.324 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:30.325 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:30.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:30 gibba001 conmon[29242]: cluster 2021-02-10T23:55:29.410113+0000 mgr.x (mgr.14140) 518 : cluster [DBG] pgmap v386: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:30.909 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":386,"stamp":"2021-02-10T23:55:29.409991+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738514,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.50800000000000001}]}]}]}} 2021-02-10T23:55:30.910 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:55:31.057 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:31.539 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:31 gibba001 conmon[29242]: audit 2021-02-10T23:55:30.324803+0000 mgr.x (mgr.14140) 519 : audit [DBG] from='client.14596 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:37.370 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:37.370 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":790,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:55:37.370 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:32 gibba001 conmon[29242]: cluster 2021-02-10T23:55:31.410347+0000 mgr.x (mgr.14140) 520 : cluster [DBG] pgmap v387: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:37.370 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:33 gibba001 conmon[29242]: audit 2021-02-10T23:55:32.603970+0000 mon.a (mon.0) 304 : audit [DBG] from='client.? 172.21.2.101:0/2378908602' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:55:37.370 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:34 gibba001 conmon[29242]: cluster 2021-02-10T23:55:33.410968+0000 mgr.x (mgr.14140) 521 : cluster [DBG] pgmap v388: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:37.370 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:36 gibba001 conmon[29242]: cluster 2021-02-10T23:55:35.411459+0000 mgr.x (mgr.14140) 522 : cluster [DBG] pgmap v389: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:37.371 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:55:37.371 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:37.517 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:38.059 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:37 gibba001 conmon[29242]: cluster 2021-02-10T23:55:37.411716+0000 mgr.x (mgr.14140) 523 : cluster [DBG] pgmap v390: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:39.083 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:39.084 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:39.825 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":390,"stamp":"2021-02-10T23:55:37.411601+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574991,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738516,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.501},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.44800000000000001}]}]}]}} 2021-02-10T23:55:40.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:40 gibba001 conmon[29242]: audit 2021-02-10T23:55:39.083439+0000 mgr.x (mgr.14140) 524 : audit [DBG] from='client.14600 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:40.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:40 gibba001 conmon[29242]: cluster 2021-02-10T23:55:39.412129+0000 mgr.x (mgr.14140) 525 : cluster [DBG] pgmap v391: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:42.827 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:55:42.846 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:42 gibba001 conmon[29242]: cluster 2021-02-10T23:55:41.412765+0000 mgr.x (mgr.14140) 526 : cluster [DBG] pgmap v392: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:42.974 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:44.567 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:45.911 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:55:45.911 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:44 gibba001 conmon[29242]: cluster 2021-02-10T23:55:43.413026+0000 mgr.x (mgr.14140) 527 : cluster [DBG] pgmap v393: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:45.911 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2021-02-10T23:55:43.412876+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574992,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.33500000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738517,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.46899999999999997}]}]}]}} 2021-02-10T23:55:45.912 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:55:45.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:45 gibba001 conmon[29242]: audit 2021-02-10T23:55:44.567188+0000 mgr.x (mgr.14140) 528 : audit [DBG] from='client.14602 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:55:46.097 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:55:46.601 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:46 gibba001 conmon[29242]: cluster 2021-02-10T23:55:45.413493+0000 mgr.x (mgr.14140) 529 : cluster [DBG] pgmap v394: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.985 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:55:59.985 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":806,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:55:59.985 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:47 gibba001 conmon[29242]: cluster 2021-02-10T23:55:47.413866+0000 mgr.x (mgr.14140) 530 : cluster [DBG] pgmap v395: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:47 gibba001 conmon[29242]: audit 2021-02-10T23:55:47.686059+0000 mon.a (mon.0) 305 : audit [DBG] from='client.? 172.21.2.101:0/2730973469' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:50 gibba001 conmon[29242]: cluster 2021-02-10T23:55:49.414513+0000 mgr.x (mgr.14140) 531 : cluster [DBG] pgmap v396: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:52 gibba001 conmon[29242]: cluster 2021-02-10T23:55:51.415199+0000 mgr.x (mgr.14140) 532 : cluster [DBG] pgmap v397: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:53 gibba001 conmon[29242]: audit 2021-02-10T23:55:53.374795+0000 mon.a (mon.0) 306 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:53 gibba001 conmon[29242]: audit 2021-02-10T23:55:53.374957+0000 mon.a (mon.0) 307 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:54 gibba001 conmon[29242]: cluster 2021-02-10T23:55:53.415697+0000 mgr.x (mgr.14140) 533 : cluster [DBG] pgmap v398: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:56 gibba001 conmon[29242]: cluster 2021-02-10T23:55:55.416433+0000 mgr.x (mgr.14140) 534 : cluster [DBG] pgmap v399: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:55:57 gibba001 conmon[29242]: cluster 2021-02-10T23:55:57.417173+0000 mgr.x (mgr.14140) 535 : cluster [DBG] pgmap v400: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:55:59.986 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:55:53 gibba001 conmon[29628]: debug 2021-02-10T23:55:53.266+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:55:59.987 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:55:59.987 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:00.169 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:00.653 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:00 gibba001 conmon[29242]: cluster 2021-02-10T23:55:59.417587+0000 mgr.x (mgr.14140) 536 : cluster [DBG] pgmap v401: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:01.760 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:01.762 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:02.376 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":402,"stamp":"2021-02-10T23:56:01.417715+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738520,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.48999999999999999}]}]}]}} 2021-02-10T23:56:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:02 gibba001 conmon[29242]: cluster 2021-02-10T23:56:01.417866+0000 mgr.x (mgr.14140) 537 : cluster [DBG] pgmap v402: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:03.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:03 gibba001 conmon[29242]: audit 2021-02-10T23:56:01.760470+0000 mgr.x (mgr.14140) 538 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:04.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:04 gibba001 conmon[29242]: cluster 2021-02-10T23:56:03.418522+0000 mgr.x (mgr.14140) 539 : cluster [DBG] pgmap v403: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:05.378 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:05.522 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:06.738 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:06 gibba001 conmon[29242]: cluster 2021-02-10T23:56:05.418810+0000 mgr.x (mgr.14140) 540 : cluster [DBG] pgmap v404: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:06.992 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:06.993 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:07.584 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":404,"stamp":"2021-02-10T23:56:05.418686+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574997,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.45600000000000002,"15min":0.44500000000000001},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.26400000000000001},"max":{"1min":0.66000000000000003,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.46300000000000002,"5min":0.45500000000000002,"15min":0.45200000000000001},"min":{"1min":0.378,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.58299999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738521,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:55:09 2021","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.442,"15min":0.44400000000000001},"min":{"1min":0.28999999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.64300000000000002,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.442,"15min":0.44900000000000001},"min":{"1min":0.34100000000000003,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.41199999999999998}]}]}]}} 2021-02-10T23:56:07.586 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:56:07.733 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:07.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:07 gibba001 conmon[29242]: audit 2021-02-10T23:56:06.992050+0000 mgr.x (mgr.14140) 541 : audit [DBG] from='client.14608 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:07.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:07 gibba001 conmon[29242]: cluster 2021-02-10T23:56:07.419621+0000 mgr.x (mgr.14140) 542 : cluster [DBG] pgmap v405: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:09.356 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:17.867 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":827,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:56:17.868 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:09 gibba001 conmon[29242]: audit 2021-02-10T23:56:09.356719+0000 mon.a (mon.0) 308 : audit [DBG] from='client.? 172.21.2.101:0/832118598' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:56:17.868 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:10 gibba001 conmon[29242]: cluster 2021-02-10T23:56:09.419816+0000 mgr.x (mgr.14140) 543 : cluster [DBG] pgmap v406: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:17.868 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:12 gibba001 conmon[29242]: cluster 2021-02-10T23:56:11.420584+0000 mgr.x (mgr.14140) 544 : cluster [DBG] pgmap v407: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:17.869 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:14 gibba001 conmon[29242]: cluster 2021-02-10T23:56:13.421060+0000 mgr.x (mgr.14140) 545 : cluster [DBG] pgmap v408: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:17.869 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:16 gibba001 conmon[29242]: cluster 2021-02-10T23:56:15.421521+0000 mgr.x (mgr.14140) 546 : cluster [DBG] pgmap v409: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:17.869 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:56:17.869 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:18.013 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:18.198 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:17 gibba001 conmon[29242]: cluster 2021-02-10T23:56:17.421990+0000 mgr.x (mgr.14140) 547 : cluster [DBG] pgmap v410: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.449 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:31.449 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2021-02-10T23:56:19.422152+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.375},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.47299999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738524,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:56:10 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.52500000000000002,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.39300000000000002}]}]}]}} 2021-02-10T23:56:31.450 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:31.450 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:20 gibba001 conmon[29242]: cluster 2021-02-10T23:56:19.422267+0000 mgr.x (mgr.14140) 548 : cluster [DBG] pgmap v411: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:20 gibba001 conmon[29242]: audit 2021-02-10T23:56:19.591876+0000 mgr.x (mgr.14140) 549 : audit [DBG] from='client.14612 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:22 gibba001 conmon[29242]: cluster 2021-02-10T23:56:21.423001+0000 mgr.x (mgr.14140) 550 : cluster [DBG] pgmap v412: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:24 gibba001 conmon[29242]: cluster 2021-02-10T23:56:23.423316+0000 mgr.x (mgr.14140) 551 : cluster [DBG] pgmap v413: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:26 gibba001 conmon[29242]: cluster 2021-02-10T23:56:25.423972+0000 mgr.x (mgr.14140) 552 : cluster [DBG] pgmap v414: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:27 gibba001 conmon[29242]: cluster 2021-02-10T23:56:27.424514+0000 mgr.x (mgr.14140) 553 : cluster [DBG] pgmap v415: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:31.451 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:30 gibba001 conmon[29242]: cluster 2021-02-10T23:56:29.425254+0000 mgr.x (mgr.14140) 554 : cluster [DBG] pgmap v416: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:32.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:32 gibba001 conmon[29242]: cluster 2021-02-10T23:56:31.425604+0000 mgr.x (mgr.14140) 555 : cluster [DBG] pgmap v417: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:34.451 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:34.599 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:34.823 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:34 gibba001 conmon[29242]: cluster 2021-02-10T23:56:33.426092+0000 mgr.x (mgr.14140) 556 : cluster [DBG] pgmap v418: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:36.254 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:36.255 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:36.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:36 gibba001 conmon[29242]: cluster 2021-02-10T23:56:35.426511+0000 mgr.x (mgr.14140) 557 : cluster [DBG] pgmap v419: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:36.830 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":419,"stamp":"2021-02-10T23:56:35.426388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738527,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:56:10 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.52500000000000002,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.54300000000000004}]}]}]}} 2021-02-10T23:56:36.831 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:56:36.978 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:37.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:37 gibba001 conmon[29242]: audit 2021-02-10T23:56:36.253687+0000 mgr.x (mgr.14140) 558 : audit [DBG] from='client.14614 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:38.580 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:38.580 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":856,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:56:38.799 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:38 gibba001 conmon[29242]: cluster 2021-02-10T23:56:37.426753+0000 mgr.x (mgr.14140) 559 : cluster [DBG] pgmap v420: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:39.199 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:56:39.199 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:39.346 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:39.884 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:39 gibba001 conmon[29242]: audit 2021-02-10T23:56:38.580518+0000 mon.a (mon.0) 309 : audit [DBG] from='client.? 172.21.2.101:0/1510917455' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:56:40.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:40 gibba001 conmon[29242]: cluster 2021-02-10T23:56:39.427147+0000 mgr.x (mgr.14140) 560 : cluster [DBG] pgmap v421: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:51.361 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:51.361 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":421,"stamp":"2021-02-10T23:56:39.426995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.58499999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738528,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:56:10 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.52500000000000002,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.47999999999999998}]}]}]}} 2021-02-10T23:56:51.361 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:51.362 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:42 gibba001 conmon[29242]: audit 2021-02-10T23:56:40.826000+0000 mgr.x (mgr.14140) 561 : audit [DBG] from='client.14618 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:51.362 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:42 gibba001 conmon[29242]: cluster 2021-02-10T23:56:41.427531+0000 mgr.x (mgr.14140) 562 : cluster [DBG] pgmap v422: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:51.362 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:42 gibba001 conmon[29242]: 2021-02-10T23:56:51.362 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:44 gibba001 conmon[29242]: cluster 2021-02-10T23:56:43.428012+0000 mgr.x (mgr.14140) 563 : cluster [DBG] pgmap v423: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:51.363 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:46 gibba001 conmon[29242]: cluster 2021-02-10T23:56:45.428532+0000 mgr.x (mgr.14140) 564 : cluster [DBG] pgmap v424: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:51.363 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:47 gibba001 conmon[29242]: cluster 2021-02-10T23:56:47.429198+0000 mgr.x (mgr.14140) 565 : cluster [DBG] pgmap v425: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:51.363 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:50 gibba001 conmon[29242]: cluster 2021-02-10T23:56:49.429535+0000 mgr.x (mgr.14140) 566 : cluster [DBG] pgmap v426: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:52.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:52 gibba001 conmon[29242]: cluster 2021-02-10T23:56:51.430216+0000 mgr.x (mgr.14140) 567 : cluster [DBG] pgmap v427: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:53.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:56:53 gibba001 conmon[29628]: debug 2021-02-10T23:56:53.268+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:56:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:53 gibba001 conmon[29242]: audit 2021-02-10T23:56:53.377209+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:56:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:53 gibba001 conmon[29242]: audit 2021-02-10T23:56:53.377359+0000 mon.a (mon.0) 311 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:56:54.363 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:56:54.511 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:54.697 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:54 gibba001 conmon[29242]: cluster 2021-02-10T23:56:53.430926+0000 mgr.x (mgr.14140) 568 : cluster [DBG] pgmap v428: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:56.037 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:57.613 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:56:57.613 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2021-02-10T23:56:55.431403+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.47199999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738531,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:56:10 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.437},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.52500000000000002,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.55000000000000004}]}]}]}} 2021-02-10T23:56:57.613 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:56 gibba001 conmon[29242]: cluster 2021-02-10T23:56:55.431554+0000 mgr.x (mgr.14140) 569 : cluster [DBG] pgmap v429: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:57.614 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:56:57.765 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:56:57.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:57 gibba001 conmon[29242]: audit 2021-02-10T23:56:56.037173+0000 mgr.x (mgr.14140) 570 : audit [DBG] from='client.14620 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:56:58.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:58 gibba001 conmon[29242]: cluster 2021-02-10T23:56:57.432002+0000 mgr.x (mgr.14140) 571 : cluster [DBG] pgmap v430: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:56:59.395 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:56:59.395 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":877,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:56:59.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:56:59 gibba001 conmon[29242]: audit 2021-02-10T23:56:59.396047+0000 mon.a (mon.0) 312 : audit [DBG] from='client.? 172.21.2.101:0/1810781170' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:57:00.016 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:57:00.017 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:00.163 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:00.692 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:00 gibba001 conmon[29242]: cluster 2021-02-10T23:56:59.432448+0000 mgr.x (mgr.14140) 572 : cluster [DBG] pgmap v431: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:01.785 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:09.251 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:09.252 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":432,"stamp":"2021-02-10T23:57:01.432604+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575008,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.44500000000000001,"15min":0.443},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.55900000000000005,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.45300000000000001},"min":{"1min":0.35399999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.56999999999999995,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.52100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738532,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:56:10 2021","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.443,"15min":0.44},"min":{"1min":0.29499999999999998,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.54300000000000004,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.44600000000000001,"5min":0.443,"15min":0.44800000000000001},"min":{"1min":0.35099999999999998,"5min":0.32300000000000001,"15min":0.28699999999999998},"max":{"1min":0.52500000000000002,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.374}]}]}]}} 2021-02-10T23:57:09.252 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:02 gibba001 conmon[29242]: cluster 2021-02-10T23:57:01.432728+0000 mgr.x (mgr.14140) 573 : cluster [DBG] pgmap v432: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:09.252 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:03 gibba001 conmon[29242]: audit 2021-02-10T23:57:01.784821+0000 mgr.x (mgr.14140) 574 : audit [DBG] from='client.14624 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:09.252 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:04 gibba001 conmon[29242]: cluster 2021-02-10T23:57:03.433384+0000 mgr.x (mgr.14140) 575 : cluster [DBG] pgmap v433: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:09.253 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:06 gibba001 conmon[29242]: cluster 2021-02-10T23:57:05.434161+0000 mgr.x (mgr.14140) 576 : cluster [DBG] pgmap v434: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:09.253 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:07 gibba001 conmon[29242]: cluster 2021-02-10T23:57:07.434714+0000 mgr.x (mgr.14140) 577 : cluster [DBG] pgmap v435: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:10.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:10 gibba001 conmon[29242]: cluster 2021-02-10T23:57:09.435447+0000 mgr.x (mgr.14140) 578 : cluster [DBG] pgmap v436: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:12.253 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:19.871 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:12 gibba001 conmon[29242]: cluster 2021-02-10T23:57:11.435820+0000 mgr.x (mgr.14140) 579 : cluster [DBG] pgmap v437: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:19.871 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:14 gibba001 conmon[29242]: cluster 2021-02-10T23:57:13.436514+0000 mgr.x (mgr.14140) 580 : cluster [DBG] pgmap v438: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:19.871 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:16 gibba001 conmon[29242]: cluster 2021-02-10T23:57:15.437039+0000 mgr.x (mgr.14140) 581 : cluster [DBG] pgmap v439: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:19.871 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:17 gibba001 conmon[29242]: cluster 2021-02-10T23:57:17.437802+0000 mgr.x (mgr.14140) 582 : cluster [DBG] pgmap v440: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:20.016 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:20.545 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:20 gibba001 conmon[29242]: cluster 2021-02-10T23:57:19.438528+0000 mgr.x (mgr.14140) 583 : cluster [DBG] pgmap v441: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:21.602 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:22.744 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:22.744 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":442,"stamp":"2021-02-10T23:57:21.438670+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575012,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.46999999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738536,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.52300000000000002}]}]}]}} 2021-02-10T23:57:22.745 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:57:22.764 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:22 gibba001 conmon[29242]: cluster 2021-02-10T23:57:21.438795+0000 mgr.x (mgr.14140) 584 : cluster [DBG] pgmap v442: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:22.764 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:22 gibba001 conmon[29242]: audit 2021-02-10T23:57:21.602140+0000 mgr.x (mgr.14140) 585 : audit [DBG] from='client.14626 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:22.892 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:24.542 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:24.542 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":902,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:57:24.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:24 gibba001 conmon[29242]: cluster 2021-02-10T23:57:23.439294+0000 mgr.x (mgr.14140) 586 : cluster [DBG] pgmap v443: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:25.180 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:57:25.180 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:25.366 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:25.816 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:25 gibba001 conmon[29242]: audit 2021-02-10T23:57:24.542677+0000 mon.a (mon.0) 313 : audit [DBG] from='client.? 172.21.2.101:0/2009659013' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:57:26.932 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:38.496 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:26 gibba001 conmon[29242]: cluster 2021-02-10T23:57:25.439526+0000 mgr.x (mgr.14140) 587 : cluster [DBG] pgmap v444: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:27 gibba001 conmon[29242]: audit 2021-02-10T23:57:26.932043+0000 mgr.x (mgr.14140) 588 : audit [DBG] from='client.14630 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:27 gibba001 conmon[29242]: cluster 2021-02-10T23:57:27.439848+0000 mgr.x (mgr.14140) 589 : cluster [DBG] pgmap v445: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:30 gibba001 conmon[29242]: cluster 2021-02-10T23:57:29.440330+0000 mgr.x (mgr.14140) 590 : cluster [DBG] pgmap v446: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:32 gibba001 conmon[29242]: cluster 2021-02-10T23:57:31.441108+0000 mgr.x (mgr.14140) 591 : cluster [DBG] pgmap v447: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:34 gibba001 conmon[29242]: cluster 2021-02-10T23:57:33.441840+0000 mgr.x (mgr.14140) 592 : cluster [DBG] pgmap v448: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:36 gibba001 conmon[29242]: cluster 2021-02-10T23:57:35.442533+0000 mgr.x (mgr.14140) 593 : cluster [DBG] pgmap v449: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:37 gibba001 conmon[29242]: cluster 2021-02-10T23:57:37.442830+0000 mgr.x (mgr.14140) 594 : cluster [DBG] pgmap v450: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:38.497 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":444,"stamp":"2021-02-10T23:57:25.439409+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575013,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.40799999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738537,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.40000000000000002}]}]}]}} 2021-02-10T23:57:40.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:40 gibba001 conmon[29242]: cluster 2021-02-10T23:57:39.443505+0000 mgr.x (mgr.14140) 595 : cluster [DBG] pgmap v451: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:41.499 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:41.645 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:42.795 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:42 gibba001 conmon[29242]: cluster 2021-02-10T23:57:41.443989+0000 mgr.x (mgr.14140) 596 : cluster [DBG] pgmap v452: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:43.277 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:43.278 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:43.943 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2021-02-10T23:57:41.443810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575016,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.55700000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738540,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.495}]}]}]}} 2021-02-10T23:57:43.944 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:57:44.090 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:44.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:44 gibba001 conmon[29242]: audit 2021-02-10T23:57:43.276739+0000 mgr.x (mgr.14140) 597 : audit [DBG] from='client.14632 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:44.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:44 gibba001 conmon[29242]: cluster 2021-02-10T23:57:43.444392+0000 mgr.x (mgr.14140) 598 : cluster [DBG] pgmap v453: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:45.705 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:45.706 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":924,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:57:46.302 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:57:46.302 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:46.450 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:46.697 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:46 gibba001 conmon[29242]: cluster 2021-02-10T23:57:45.444745+0000 mgr.x (mgr.14140) 599 : cluster [DBG] pgmap v454: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:46.697 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:46 gibba001 conmon[29242]: audit 2021-02-10T23:57:45.706340+0000 mon.a (mon.0) 314 : audit [DBG] from='client.? 172.21.2.101:0/1545568193' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:57:47.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:47 gibba001 conmon[29242]: cluster 2021-02-10T23:57:47.445309+0000 mgr.x (mgr.14140) 600 : cluster [DBG] pgmap v455: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:51.737 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:51.738 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":455,"stamp":"2021-02-10T23:57:47.445189+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575017,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.56499999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738542,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.35499999999999998}]}]}]}} 2021-02-10T23:57:51.738 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:51.739 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:48 gibba001 conmon[29242]: audit 2021-02-10T23:57:48.108069+0000 mgr.x (mgr.14140) 601 : audit [DBG] from='client.14636 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:51.739 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:49 gibba001 conmon[29242]: cluster 2021-02-10T23:57:49.445987+0000 mgr.x (mgr.14140) 602 : cluster [DBG] pgmap v456: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:52.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:52 gibba001 conmon[29242]: cluster 2021-02-10T23:57:51.446668+0000 mgr.x (mgr.14140) 603 : cluster [DBG] pgmap v457: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:53 gibba001 conmon[29242]: audit 2021-02-10T23:57:53.379579+0000 mon.a (mon.0) 315 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:57:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:53 gibba001 conmon[29242]: audit 2021-02-10T23:57:53.379775+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:57:53.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:57:53 gibba001 conmon[29628]: debug 2021-02-10T23:57:53.269+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:57:54.739 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:54.757 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:54 gibba001 conmon[29242]: cluster 2021-02-10T23:57:53.447141+0000 mgr.x (mgr.14140) 604 : cluster [DBG] pgmap v458: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:54.885 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:56.390 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:56.391 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:57:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:56 gibba001 conmon[29242]: cluster 2021-02-10T23:57:55.447592+0000 mgr.x (mgr.14140) 605 : cluster [DBG] pgmap v459: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:56.997 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":459,"stamp":"2021-02-10T23:57:55.447320+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738543,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.45100000000000001}]}]}]}} 2021-02-10T23:57:56.998 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:57:57.185 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:57.699 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:57 gibba001 conmon[29242]: audit 2021-02-10T23:57:56.390397+0000 mgr.x (mgr.14140) 606 : audit [DBG] from='client.14638 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:57:58.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:58 gibba001 conmon[29242]: cluster 2021-02-10T23:57:57.448046+0000 mgr.x (mgr.14140) 607 : cluster [DBG] 2021-02-10T23:57:59.278 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:58 gibba001 conmon[29242]: pgmap v460: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:57:59.278 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:57:59.278 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":937,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:57:59.380 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:57:59.381 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:57:59.527 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:57:59.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:57:59 gibba001 conmon[29242]: audit 2021-02-10T23:57:58.767967+0000 mon.a (mon.0) 317 : audit [DBG] from='client.? 172.21.2.101:0/3332928401' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:58:00.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:00 gibba001 conmon[29242]: cluster 2021-02-10T23:57:59.448277+0000 mgr.x (mgr.14140) 608 : cluster [DBG] pgmap v461: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:01.083 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:01.084 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:01.699 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":461,"stamp":"2021-02-10T23:57:59.448164+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575019,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.42499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738544,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.47399999999999998}]}]}]}} 2021-02-10T23:58:02.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:02 gibba001 conmon[29242]: audit 2021-02-10T23:58:01.083789+0000 mgr.x (mgr.14140) 609 : audit [DBG] from='client.14642 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:11.647 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:02 gibba001 conmon[29242]: cluster 2021-02-10T23:58:01.448619+0000 mgr.x (mgr.14140) 610 : cluster [DBG] pgmap v462: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:11.648 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:11.649 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:04 gibba001 conmon[29242]: cluster 2021-02-10T23:58:03.449358+0000 mgr.x (mgr.14140) 611 : cluster [DBG] pgmap v463: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:11.649 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:06 gibba001 conmon[29242]: cluster 2021-02-10T23:58:05.450051+0000 mgr.x (mgr.14140) 612 : cluster [DBG] pgmap v464: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:11.649 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:07 gibba001 conmon[29242]: cluster 2021-02-10T23:58:07.450594+0000 mgr.x (mgr.14140) 613 : cluster [DBG] pgmap v465: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:11.649 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:10 gibba001 conmon[29242]: cluster 2021-02-10T23:58:09.451017+0000 mgr.x (mgr.14140) 614 : cluster [DBG] pgmap v466: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:11.797 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:12 gibba001 conmon[29242]: cluster 2021-02-10T23:58:11.451615+0000 mgr.x (mgr.14140) 615 : cluster [DBG] pgmap v467: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:13.332 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:13.333 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:13.911 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2021-02-10T23:58:11.451434+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575022,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:57:13 2021","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.33000000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.58099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.498,"5min":0.46899999999999997,"15min":0.45600000000000002},"min":{"1min":0.40100000000000002,"5min":0.32900000000000001,"15min":0.30599999999999999},"max":{"1min":0.58499999999999996,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.39600000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738546,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:57:11 2021","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.44600000000000001,"15min":0.439},"min":{"1min":0.36199999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.61599999999999999,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.46999999999999997,"5min":0.45300000000000001,"15min":0.44700000000000001},"min":{"1min":0.34799999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.55000000000000004,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.46200000000000002}]}]}]}} 2021-02-10T23:58:13.912 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:58:14.060 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:14.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:14 gibba001 conmon[29242]: audit 2021-02-10T23:58:13.327411+0000 mgr.x (mgr.14140) 616 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:14.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:14 gibba001 conmon[29242]: cluster 2021-02-10T23:58:13.452127+0000 mgr.x (mgr.14140) 617 2021-02-10T23:58:14.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:14 gibba001 conmon[29242]: : cluster [DBG] pgmap v468: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:15.710 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:15.710 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":954,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:58:16.334 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:58:16.334 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:16.482 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:16.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:16 gibba001 conmon[29242]: cluster 2021-02-10T23:58:15.452368+0000 mgr.x (mgr.14140) 618 : cluster [DBG] pgmap v469: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:20.350 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:16 gibba001 conmon[29242]: audit 2021-02-10T23:58:15.711229+0000 mon.a (mon.0) 318 : audit [DBG] from='client.? 172.21.2.101:0/3768009598' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:58:20.352 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:17 gibba001 conmon[29242]: cluster 2021-02-10T23:58:17.452947+0000 mgr.x (mgr.14140) 619 : cluster [DBG] pgmap v470: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:20.353 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:18 gibba001 conmon[29242]: audit 2021-02-10T23:58:18.051253+0000 mgr.x (mgr.14140) 620 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:20.353 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:19 gibba001 conmon[29242]: cluster 2021-02-10T23:58:19.453608+0000 mgr.x (mgr.14140) 621 : cluster [DBG] pgmap v471: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:20.353 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:20.353 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":470,"stamp":"2021-02-10T23:58:17.452769+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575023,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.40300000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738548,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.40600000000000003}]}]}]}} 2021-02-10T23:58:20.354 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:22.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:22 gibba001 conmon[29242]: cluster 2021-02-10T23:58:21.454048+0000 mgr.x (mgr.14140) 622 : cluster [DBG] pgmap v472: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:23.673 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:23.820 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:24.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:24 gibba001 conmon[29242]: cluster 2021-02-10T23:58:23.454752+0000 mgr.x (mgr.14140) 623 : cluster [DBG] pgmap v473: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:25.351 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:25.352 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:25.951 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":473,"stamp":"2021-02-10T23:58:23.454602+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575024,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.443}]}]},{"osd":0,"up_from":8,"seq":34359738549,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.54000000000000004}]}]}]}} 2021-02-10T23:58:25.952 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:58:26.097 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:26.570 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:26 gibba001 conmon[29242]: audit 2021-02-10T23:58:25.350640+0000 mgr.x (mgr.14140) 624 : audit [DBG] from='client.14650 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:26.570 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:26 gibba001 conmon[29242]: cluster 2021-02-10T23:58:25.455093+0000 mgr.x (mgr.14140) 625 : cluster [DBG] pgmap v474: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:27.619 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:28.351 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":966,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:58:28.352 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:27 gibba001 conmon[29242]: cluster 2021-02-10T23:58:27.455386+0000 mgr.x (mgr.14140) 626 : cluster [DBG] pgmap v475: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:28.352 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:27 gibba001 conmon[29242]: audit 2021-02-10T23:58:27.620064+0000 mon.a (mon.0) 319 : audit [DBG] from='client.? 172.21.2.101:0/1494633448' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:58:28.353 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:58:28.353 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:28.502 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:30.044 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:30.045 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:30.655 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":476,"stamp":"2021-02-10T23:58:29.455694+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575025,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.56699999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738550,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.34899999999999998}]}]}]}} 2021-02-10T23:58:30.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:30 gibba001 conmon[29242]: cluster 2021-02-10T23:58:29.455822+0000 mgr.x (mgr.14140) 627 : cluster [DBG] pgmap v476: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:31.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:31 gibba001 conmon[29242]: audit 2021-02-10T23:58:30.044078+0000 mgr.x (mgr.14140) 628 : audit [DBG] from='client.14654 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:33.207 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:32 gibba001 conmon[29242]: cluster 2021-02-10T23:58:31.456319+0000 mgr.x (mgr.14140) 629 : cluster [DBG] pgmap v477: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:33.657 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:33.804 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:34.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:34 gibba001 conmon[29242]: cluster 2021-02-10T23:58:33.456594+0000 mgr.x (mgr.14140) 630 : cluster [DBG] pgmap v478: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:35.434 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:35.435 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:36.080 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":478,"stamp":"2021-02-10T23:58:33.456418+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575026,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.49199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738551,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.505}]}]}]}} 2021-02-10T23:58:36.081 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:58:36.229 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:36.747 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:36 gibba001 conmon[29242]: audit 2021-02-10T23:58:35.434052+0000 mgr.x (mgr.14140) 631 : audit [DBG] from='client.14656 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:36.747 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:36 gibba001 conmon[29242]: cluster 2021-02-10T23:58:35.456820+0000 mgr.x (mgr.14140) 632 : cluster [DBG] pgmap v479: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:37.874 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:37.874 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":976,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":4,"modified":"2021-02-10T23:44:51.266459+0000","services":{}},"progress_events":{}} 2021-02-10T23:58:38.110 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:37 gibba001 conmon[29242]: cluster 2021-02-10T23:58:37.457238+0000 mgr.x (mgr.14140) 633 : cluster [DBG] pgmap v480: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:38.526 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:58:38.527 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:38.676 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:39.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:38 gibba001 conmon[29242]: audit 2021-02-10T23:58:37.874317+0000 mon.a (mon.0) 320 : audit [DBG] from='client.? 172.21.2.101:0/4271286479' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:58:40.090 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:39 gibba001 conmon[29242]: cluster 2021-02-10T23:58:39.457463+0000 mgr.x (mgr.14140) 634 : cluster [DBG] pgmap v481: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:40.360 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:40.361 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:40.977 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2021-02-10T23:58:39.457356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575027,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.38100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738552,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.378},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.497}]}]}]}} 2021-02-10T23:58:47.019 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:40 gibba001 conmon[29242]: audit 2021-02-10T23:58:40.360374+0000 mgr.x (mgr.14140) 635 : audit [DBG] from='client.14660 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:58:47.019 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:41 gibba001 conmon[29242]: cluster 2021-02-10T23:58:41.458181+0000 mgr.x (mgr.14140) 636 : cluster [DBG] pgmap v482: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:47.020 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:44 gibba001 conmon[29242]: cluster 2021-02-10T23:58:43.458434+0000 mgr.x (mgr.14140) 637 : cluster [DBG] pgmap v483: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:47.020 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:46 gibba001 conmon[29242]: cluster 2021-02-10T23:58:45.459130+0000 mgr.x (mgr.14140) 638 : cluster [DBG] pgmap v484: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:48.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:47 gibba001 conmon[29242]: cluster 2021-02-10T23:58:47.459528+0000 mgr.x (mgr.14140) 639 : cluster [DBG] pgmap v485: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:50.818 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:58:50.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:50 gibba001 conmon[29242]: cluster 2021-02-10T23:58:49.460135+0000 mgr.x (mgr.14140) 640 : cluster [DBG] pgmap v486: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:50.966 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:58:52.519 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:58:52.520 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:58:52.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:52 gibba001 conmon[29242]: cluster 2021-02-10T23:58:51.460353+0000 mgr.x (mgr.14140) 641 : cluster [DBG] pgmap v487: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:58:53.153 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":487,"stamp":"2021-02-10T23:58:51.460246+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575030,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.53200000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738554,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.504}]}]}]}} 2021-02-10T23:59:02.376 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:59:02.378 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:58:53 gibba001 conmon[29628]: debug 2021-02-10T23:58:53.270+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:59:02.378 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:53 gibba001 conmon[29242]: audit 2021-02-10T23:58:52.519129+0000 mgr.x (mgr.14140) 642 : audit [DBG] from='client.14662 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:02.378 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:53 gibba001 conmon[29242]: audit 2021-02-10T23:58:53.382164+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:59:02.378 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:53 gibba001 conmon[29242]: audit 2021-02-10T23:58:53.382336+0000 mon.a (mon.0) 322 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:59:02.379 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:53 gibba001 conmon[29242]: 2021-02-10T23:59:02.379 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:54 gibba001 conmon[29242]: cluster 2021-02-10T23:58:53.460975+0000 mgr.x (mgr.14140) 643 : cluster [DBG] pgmap v488: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:02.379 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:56 gibba001 conmon[29242]: cluster 2021-02-10T23:58:55.461654+0000 mgr.x (mgr.14140) 644 : cluster [DBG] pgmap v489: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:02.379 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:58:57 gibba001 conmon[29242]: cluster 2021-02-10T23:58:57.462196+0000 mgr.x (mgr.14140) 645 : cluster [DBG] pgmap v490: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:02.379 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:00 gibba001 conmon[29242]: cluster 2021-02-10T23:58:59.462515+0000 mgr.x (mgr.14140) 646 : cluster [DBG] pgmap v491: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:02.524 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:02.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:02 gibba001 conmon[29242]: cluster 2021-02-10T23:59:01.463176+0000 mgr.x (mgr.14140) 647 : cluster [DBG] pgmap v492: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:04.252 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:04.252 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1002,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":5,"modified":"2021-02-10T23:58:55.461500+0000","services":{"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:59:04.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:04 gibba001 conmon[29242]: cluster 2021-02-10T23:59:03.463474+0000 mgr.x (mgr.14140) 648 : cluster [DBG] pgmap v493: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:04.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:04 gibba001 conmon[29242]: audit 2021-02-10T23:59:04.252813+0000 mon.a (mon.0) 323 : audit [DBG] from='client.? 172.21.2.101:0/4092887943' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:59:04.839 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:59:04.839 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:04.983 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:06.534 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:06.536 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:06.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:06 gibba001 conmon[29242]: cluster 2021-02-10T23:59:05.463884+0000 mgr.x (mgr.14140) 649 : cluster [DBG] pgmap v494: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:09.531 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2021-02-10T23:59:05.463761+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575033,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.52100000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738557,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.41899999999999998}]}]}]}} 2021-02-10T23:59:09.531 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:07 gibba001 conmon[29242]: audit 2021-02-10T23:59:06.534308+0000 mgr.x (mgr.14140) 650 : audit [DBG] from='client.14666 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:09.531 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:08 gibba001 conmon[29242]: cluster 2021-02-10T23:59:07.464417+0000 mgr.x (mgr.14140) 651 : cluster [DBG] pgmap v495: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:10.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:10 gibba001 conmon[29242]: cluster 2021-02-10T23:59:09.465080+0000 mgr.x (mgr.14140) 652 : cluster [DBG] pgmap v496: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:12.533 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:12.680 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:12.931 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:12 gibba001 conmon[29242]: cluster 2021-02-10T23:59:11.465842+0000 mgr.x (mgr.14140) 653 : cluster [DBG] pgmap v497: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:14.312 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:14.313 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:14.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:14 gibba001 conmon[29242]: cluster 2021-02-10T23:59:13.466246+0000 mgr.x (mgr.14140) 654 : cluster [DBG] pgmap v498: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:14.918 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":498,"stamp":"2021-02-10T23:59:13.466124+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575034,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:58:13 2021","interfaces":[{"interface":"back","average":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.44500000000000001},"min":{"1min":0.34200000000000003,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59299999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.46800000000000003,"15min":0.45700000000000002},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.40699999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738559,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:58:12 2021","interfaces":[{"interface":"back","average":{"1min":0.45500000000000002,"5min":0.44900000000000001,"15min":0.437},"min":{"1min":0.32100000000000001,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.55100000000000005,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.442},{"interface":"front","average":{"1min":0.45700000000000002,"5min":0.45400000000000001,"15min":0.44600000000000001},"min":{"1min":0.35299999999999998,"5min":0.32400000000000001,"15min":0.28699999999999998},"max":{"1min":0.53200000000000003,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.39100000000000001}]}]}]}} 2021-02-10T23:59:14.920 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:59:15.070 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:15.594 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:15 gibba001 conmon[29242]: audit 2021-02-10T23:59:14.312539+0000 mgr.x (mgr.14140) 655 : audit [DBG] from='client.14668 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:16.643 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:25.583 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1015,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":5,"modified":"2021-02-10T23:58:55.461500+0000","services":{"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:59:25.585 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:16 gibba001 conmon[29242]: cluster 2021-02-10T23:59:15.466637+0000 mgr.x (mgr.14140) 656 : cluster [DBG] 2021-02-10T23:59:25.585 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:16 gibba001 conmon[29242]: pgmap v499: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:25.585 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:17 gibba001 conmon[29242]: audit 2021-02-10T23:59:16.644385+0000 mon.a (mon.0) 324 : audit [DBG] from='client.? 172.21.2.101:0/393903866' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:59:25.585 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:18 gibba001 conmon[29242]: cluster 2021-02-10T23:59:17.467370+0000 mgr.x (mgr.14140) 657 : cluster [DBG] 2021-02-10T23:59:25.585 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:18 gibba001 conmon[29242]: pgmap v500: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:25.586 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:20 gibba001 conmon[29242]: cluster 2021-02-10T23:59:19.467647+0000 mgr.x (mgr.14140) 658 : cluster [DBG] pgmap v501: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:25.586 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:22 gibba001 conmon[29242]: cluster 2021-02-10T23:59:21.468383+0000 mgr.x (mgr.14140) 659 : cluster [DBG] pgmap v502: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:25.586 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:24 gibba001 conmon[29242]: cluster 2021-02-10T23:59:23.469059+0000 mgr.x (mgr.14140) 660 : cluster [DBG] pgmap v503: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:25.586 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:59:25.586 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:25.734 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:26.928 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:26 gibba001 conmon[29242]: cluster 2021-02-10T23:59:25.469512+0000 mgr.x (mgr.14140) 661 : cluster [DBG] pgmap v504: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:27.383 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:27.384 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:28.092 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:27 gibba001 conmon[29242]: audit 2021-02-10T23:59:27.383182+0000 mgr.x (mgr.14140) 662 : audit [DBG] 2021-02-10T23:59:30.097 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:27 gibba001 conmon[29242]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:30.097 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:27 gibba001 conmon[29242]: cluster 2021-02-10T23:59:27.469992+0000 mgr.x (mgr.14140) 663 : cluster [DBG] pgmap v505: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:30.098 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":504,"stamp":"2021-02-10T23:59:25.469358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575037,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.42499999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738561,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.38500000000000001}]}]}]}} 2021-02-10T23:59:30.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:30 gibba001 conmon[29242]: cluster 2021-02-10T23:59:29.470678+0000 mgr.x (mgr.14140) 664 : cluster [DBG] pgmap v506: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:32.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:32 gibba001 conmon[29242]: cluster 2021-02-10T23:59:31.471405+0000 mgr.x (mgr.14140) 665 : cluster [DBG] pgmap v507: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:33.100 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:33.249 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:34.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:34 gibba001 conmon[29242]: cluster 2021-02-10T23:59:33.471672+0000 mgr.x (mgr.14140) 666 : cluster [DBG] pgmap v508: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:34.861 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:34.862 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:35.449 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":508,"stamp":"2021-02-10T23:59:33.471548+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575038,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.48999999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738563,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.55300000000000005}]}]}]}} 2021-02-10T23:59:35.450 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:59:35.596 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:36.889 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:36 gibba001 conmon[29242]: audit 2021-02-10T23:59:34.861281+0000 mgr.x (mgr.14140) 667 : audit [DBG] from='client.14674 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:40.638 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:36 gibba001 conmon[29242]: cluster 2021-02-10T23:59:35.472026+0000 mgr.x (mgr.14140) 668 : cluster [DBG] pgmap v509: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:40.639 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:40.639 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1035,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":6,"modified":"2021-02-10T23:59:33.471579+0000","services":{"osd":{"daemons":{"summary":"","1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2021-02-10T23:59:40.640 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:37 gibba001 conmon[29242]: audit 2021-02-10T23:59:37.211813+0000 mon.a (mon.0) 325 : audit [DBG] from='client.? 172.21.2.101:0/3181595937' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:59:40.640 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:37 gibba001 conmon[29242]: cluster 2021-02-10T23:59:37.472433+0000 mgr.x (mgr.14140) 669 : cluster [DBG] pgmap v510: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:40.640 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:59:40.641 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:40.788 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:40.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:40 gibba001 conmon[29242]: cluster 2021-02-10T23:59:39.473112+0000 mgr.x (mgr 2021-02-10T23:59:40.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:40 gibba001 conmon[29242]: .14140) 670 : cluster [DBG] pgmap v511: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:42.363 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:48.289 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:48.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:42 gibba001 conmon[29242]: cluster 2021-02-10T23:59:41.473457+0000 mgr.x (mgr.14140) 671 : cluster [DBG] pgmap v512: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:48.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:43 gibba001 conmon[29242]: audit 2021-02-10T23:59:42.363139+0000 mgr.x (mgr.14140) 672 : audit [DBG] from='client.14678 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:48.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:44 gibba001 conmon[29242]: cluster 2021-02-10T23:59:43.473945+0000 mgr.x (mgr.14140) 673 : cluster [DBG] pgmap v513: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:48.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:46 gibba001 conmon[29242]: cluster 2021-02-10T23:59:45.474331+0000 mgr.x (mgr.14140) 674 : cluster [DBG] pgmap v514: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:48.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:47 gibba001 conmon[29242]: cluster 2021-02-10T23:59:47.475073+0000 mgr.x (mgr.14140) 675 : cluster [DBG] pgmap v515: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:48.289 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2021-02-10T23:59:41.473332+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575040,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.64200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738564,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.36599999999999999}]}]}]}} 2021-02-10T23:59:50.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:50 gibba001 conmon[29242]: cluster 2021-02-10T23:59:49.475659+0000 mgr.x (mgr.14140) 676 : cluster [DBG] pgmap v516: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:51.291 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:51.439 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:52.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:52 gibba001 conmon[29242]: cluster 2021-02-10T23:59:51.476006+0000 mgr.x (mgr.14140) 677 : cluster [DBG] pgmap v517: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:53.042 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:53.043 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-10T23:59:53.460 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 10 23:59:53 gibba001 conmon[29628]: debug 2021-02-10T23:59:53.271+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-10T23:59:54.300 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":517,"stamp":"2021-02-10T23:59:51.475786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575042,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.53600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738566,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.58499999999999996}]}]}]}} 2021-02-10T23:59:54.300 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:53 gibba001 conmon[29242]: audit 2021-02-10T23:59:53.384470+0000 mon.a (mon.0) 326 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-10T23:59:54.300 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:53 gibba001 conmon[29242]: audit 2021-02-10T 2021-02-10T23:59:54.300 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:53 gibba001 conmon[29242]: 23:59:53.384614+0000 mon.a (mon.0) 327 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-10T23:59:54.301 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-10T23:59:54.448 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:54.698 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:54 gibba001 conmon[29242]: audit 2021-02-10T23:59:53.042108+0000 mgr.x (mgr.14140) 678 : audit [DBG] from='client.14680 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-10T23:59:54.698 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:54 gibba001 conmon[29242]: cluster 2021-02-10T23:59:53.476434+0000 mgr.x (mgr.14140) 679 : cluster [DBG] pgmap v518: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:56.094 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-10T23:59:56.094 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1054,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-10T23:59:56.731 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-10T23:59:56.731 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-10T23:59:56.880 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-10T23:59:56.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:56 gibba001 conmon[29242]: cluster 2021-02-10T23:59:55.477029+0000 mgr.x (mgr.14140) 680 : cluster [DBG] pgmap v519: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-10T23:59:56.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:56 gibba001 conmon[29242]: audit 2021-02-10T23:59:56.094829+0000 mon.a (mon.0) 328 : audit [DBG] from='client.? 172.21.2.101:0/1799719436' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-10T23:59:58.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:57 gibba001 conmon[29242]: cluster 2021-02-10T23:59:57.477328+0000 mgr.x (mgr.14140) 681 : cluster [DBG] pgmap v520: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:01.303 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:01.304 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2021-02-10T23:59:57.477207+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575043,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.39000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738568,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.52500000000000002}]}]}]}} 2021-02-11T00:00:01.304 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:01.304 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:58 gibba001 conmon[29242]: audit 2021-02-10T23:59:58.476856+0000 mgr.x (mgr.14140) 682 : audit [DBG] from='client.14684 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:01.305 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 10 23:59:59 gibba001 conmon[29242]: cluster 2021-02-10T23:59:59.477981+0000 mgr.x (mgr.14140) 683 : cluster [DBG] pgmap v521: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:02.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:02 gibba001 conmon[29242]: cluster 2021-02-11T00:00:01.478628+0000 mgr.x (mgr.14140) 684 : cluster [DBG] pgmap v522: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:04.306 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:04.461 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:04.689 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:04 gibba001 conmon[29242]: cluster 2021-02-11T00:00:03.479364+0000 mgr.x (mgr.14140) 685 : cluster [DBG] pgmap v523: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:06.067 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:06.068 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:06.693 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":524,"stamp":"2021-02-11T00:00:05.479714+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575045,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.47699999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738569,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.48799999999999999}]}]}]}} 2021-02-11T00:00:06.694 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:00:06.841 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:06.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:06 gibba001 conmon[29242]: cluster 2021-02-11T00:00:05.479836+0000 mgr.x (mgr.14140) 686 : cluster [DBG] pgmap v524: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:07.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:07 gibba001 conmon[29242]: audit 2021-02-11T00:00:06.066764+0000 mgr.x (mgr.14140) 687 : audit [DBG] from='client.14686 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:10.851 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:10.851 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1066,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:00:10.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:08 gibba001 conmon[29242]: cluster 2021-02-11T00:00:07.480427+0000 mgr.x (mgr.14140) 688 : cluster [DBG] pgmap v525: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:10.852 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:08 gibba001 conmon[29242]: audit 2021-02-11T00:00:08.469534+0000 mon.a (mon.0) 329 : audit [DBG] from='client.? 172.21.2.101:0/3644184357' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:00:10.852 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:00:10.852 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:10.871 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:10 gibba001 conmon[29242]: cluster 2021-02-11T00:00:09.480909+0000 mgr.x (mgr.14140) 689 : cluster [DBG] pgmap v526: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:10.998 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:12 gibba001 conmon[29242]: cluster 2021-02-11T00:00:11.481334+0000 mgr.x (mgr.14140) 690 : cluster [DBG] pgmap v527: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.141 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:24.142 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":527,"stamp":"2021-02-11T00:00:11.481215+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575046,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Feb 10 23:59:15 2021","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.45800000000000002,"15min":0.44600000000000001},"min":{"1min":0.33800000000000002,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.59399999999999997,"5min":0.66000000000000003,"15min":0.70099999999999996},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.47399999999999998,"15min":0.45900000000000002},"min":{"1min":0.36499999999999999,"5min":0.32000000000000001,"15min":0.30599999999999999},"max":{"1min":0.56799999999999995,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.443}]}]},{"osd":0,"up_from":8,"seq":34359738570,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Feb 10 23:59:12 2021","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.44900000000000001,"15min":0.436},"min":{"1min":0.29599999999999999,"5min":0.28999999999999998,"15min":0.27700000000000002},"max":{"1min":0.63600000000000001,"5min":0.64300000000000002,"15min":0.66100000000000003},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.438,"5min":0.45100000000000001,"15min":0.44400000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.59399999999999997,"5min":0.69399999999999995,"15min":0.69999999999999996},"last":0.66600000000000004}]}]}]}} 2021-02-11T00:00:24.142 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:14 gibba001 conmon[29242]: audit 2021-02-11T00:00:12.732331+0000 mgr.x (mgr.14140) 691 : audit [DBG] from='client.14690 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:14 gibba001 conmon[29242]: cluster 2021-02-11T00:00:13.481915+0000 mgr.x (mgr.14140) 692 : cluster [DBG] pgmap v528: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:16 gibba001 conmon[29242]: cluster 2021-02-11T00:00:15.482681+0000 mgr.x (mgr.14140) 693 : cluster [DBG] pgmap v529: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:17 gibba001 conmon[29242]: cluster 2021-02-11T00:00:17.483358+0000 mgr.x (mgr.14140) 694 : cluster [DBG] pgmap v530: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:20 gibba001 conmon[29242]: cluster 2021-02-11T00:00:19.483632+0000 mgr.x (mgr.14140) 695 : cluster [DBG] pgmap v531: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.143 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:22 gibba001 conmon[29242]: cluster 2021-02-11T00:00:21.484326+0000 mgr.x (mgr.14140) 696 : cluster [DBG] pgmap v532: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:24.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:24 gibba001 conmon[29242]: cluster 2021-02-11T00:00:23.484996+0000 mgr.x (mgr.14140) 697 : cluster [DBG] pgmap v533: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:26.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:26 gibba001 conmon[29242]: cluster 2021-02-11T00:00:25.485732+0000 mgr.x (mgr.14140) 698 : cluster [DBG] pgmap v534: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:27.144 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:27.290 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:28.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:27 gibba001 conmon[29242]: cluster 2021-02-11T00:00:27.486056+0000 mgr.x (mgr.14140) 699 : cluster [DBG] pgmap v535: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:29.333 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:29.333 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:29.536 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":535,"stamp":"2021-02-11T00:00:27.485867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575049,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.39200000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738574,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.42399999999999999}]}]}]}} 2021-02-11T00:00:29.537 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:00:29.682 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:30.870 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:30 gibba001 conmon[29242]: audit 2021-02-11T00:00:28.891779+0000 mgr.x (mgr.14140) 700 : audit [DBG] from='client.14692 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:30.870 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:30 gibba001 conmon[29242]: cluster 2021-02-11T00:00:29.486420+0000 mgr.x (mgr.14140) 701 : cluster [DBG] pgmap v536: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:31.385 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:31.385 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1089,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:00:31.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:31 gibba001 conmon[29242]: audit 2021-02-11T00:00:31.385231+0000 mon.a (mon.0) 330 : audit [DBG] from='client.? 172.21.2.101:0/1195268561' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:00:32.000 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:00:32.001 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:32.148 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:32.610 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:32 gibba001 conmon[29242]: cluster 2021-02-11T00:00:31.486717+0000 mgr.x (mgr.14140) 702 : cluster [DBG] pgmap v537: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:33.816 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:44.165 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:44.165 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":538,"stamp":"2021-02-11T00:00:33.487009+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575050,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.371}]}]},{"osd":0,"up_from":8,"seq":34359738575,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.434},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.50600000000000001}]}]}]}} 2021-02-11T00:00:44.165 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:34 gibba001 conmon[29242]: cluster 2021-02-11T00:00:33.487135+0000 mgr.x (mgr.14140) 703 : cluster [DBG] pgmap v538: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:44.165 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:35 gibba001 conmon[29242]: audit 2021-02-11T00:00:33.816718+0000 mgr.x (mgr.14140) 704 : audit [DBG] from='client.14696 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:44.165 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:36 gibba001 conmon[29242]: cluster 2021-02-11T00:00:35.487633+0000 mgr.x (mgr.14140) 705 : cluster [DBG] pgmap v539: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:44.166 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:37 gibba001 conmon[29242]: cluster 2021-02-11T00:00:37.488317+0000 mgr.x (mgr.14140) 706 : cluster [DBG] pgmap v540: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:44.166 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:40 gibba001 conmon[29242]: cluster 2021-02-11T00:00:39.489045+0000 mgr.x (mgr.14140) 707 : cluster [DBG] pgmap v541: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:44.166 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:42 gibba001 conmon[29242]: cluster 2021-02-11T00:00:41.489749+0000 mgr.x (mgr.14140) 708 : cluster [DBG] pgmap v542: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:44.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:44 gibba001 conmon[29242]: cluster 2021-02-11T00:00:43.490438+0000 mgr.x (mgr.14140) 709 : cluster [DBG] pgmap v543: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:46.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:46 gibba001 conmon[29242]: cluster 2021-02-11T00:00:45.491094+0000 mgr.x (mgr.14140) 710 : cluster [DBG] pgmap v544: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:47.168 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:47.314 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:48.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:47 gibba001 conmon[29242]: cluster 2021-02-11T00:00:47.491744+0000 mgr.x (mgr.14140) 711 : cluster [DBG] pgmap v545: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:49.720 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:49.720 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":545,"stamp":"2021-02-11T00:00:47.491620+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575053,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.56999999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738578,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.57999999999999996}]}]}]}} 2021-02-11T00:00:49.720 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:49.721 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:00:49.865 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:50.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:50 gibba001 conmon[29242]: audit 2021-02-11T00:00:48.873953+0000 mgr.x (mgr.14140) 712 : audit [DBG] from='client.14698 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:50.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:50 gibba001 conmon[29242]: cluster 2021-02-11T00:00:49.492007+0000 mgr.x (mgr.14140) 713 : cluster [DBG] pgmap v546: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:51.577 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:51.577 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1109,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:00:52.181 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:00:52.181 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:00:52.325 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:00:52.841 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:52 gibba001 conmon[29242]: cluster 2021-02-11T00:00:51.492261+0000 mgr.x (mgr.14140) 714 : cluster [DBG] pgmap v547: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:53.391 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:52 gibba001 conmon[29242]: audit 2021-02-11T00:00:51.578148+0000 mon.a (mon.0) 331 : audit [DBG] from='client.? 172.21.2.101:0/1595699631' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:00:53.547 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:00:53 gibba001 conmon[29628]: debug 2021-02-11T00:00:53.272+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-11T00:00:53.887 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:00:53.888 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:00:53.910 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:53 gibba001 conmon[29242]: audit 2021-02-11T00:00:53.386871+0000 mon.a (mon.0) 332 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-11T00:00:53.910 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:53 gibba001 conmon[29242]: audit 2021-02-11T00:00:53.387087+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-11T00:00:54.467 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":548,"stamp":"2021-02-11T00:00:53.492526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575054,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.61099999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738579,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.432}]}]}]}} 2021-02-11T00:00:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:54 gibba001 conmon[29242]: cluster 2021-02-11T00:00:53.492646+0000 mgr.x (mgr.14140) 715 : cluster [DBG] pgmap v548: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:55.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:55 gibba001 conmon[29242]: audit 2021-02-11T00:00:53.886480+0000 mgr.x (mgr.14140) 716 : audit [DBG] from='client.14702 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:00:56.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:56 gibba001 conmon[29242]: cluster 2021-02-11T00:00:55.493323+0000 mgr.x (mgr.14140) 717 : cluster [DBG] pgmap v549: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:00:57.469 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:03.570 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:00:57 gibba001 conmon[29242]: cluster 2021-02-11T00:00:57.493933+0000 mgr.x (mgr.14140) 718 : cluster [DBG] pgmap v550: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:03.571 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:00 gibba001 conmon[29242]: cluster 2021-02-11T00:00:59.494574+0000 mgr.x (mgr.14140) 719 : cluster [DBG] pgmap v551: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:03.571 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:02 gibba001 conmon[29242]: cluster 2021-02-11T00:01:01.495039+0000 mgr.x (mgr.14140) 720 : cluster [DBG] pgmap v552: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:03.720 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:04.853 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:04 gibba001 conmon[29242]: cluster 2021-02-11T00:01:03.495586+0000 mgr.x (mgr.14140) 721 : cluster [DBG] pgmap v553: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:05.302 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:05.303 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:05.920 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":553,"stamp":"2021-02-11T00:01:03.495438+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575056,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.627}]}]},{"osd":0,"up_from":8,"seq":34359738581,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.56299999999999994}]}]}]}} 2021-02-11T00:01:05.921 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:01:06.069 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:06.594 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:06 gibba001 conmon[29242]: audit 2021-02-11T00:01:05.301728+0000 mgr.x (mgr.14140) 722 : audit [DBG] from='client.14704 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:06.594 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:06 gibba001 conmon[29242]: cluster 2021-02-11T00:01:05.495986+0000 mgr.x (mgr.14140) 723 : cluster [DBG] pgmap v554: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:07.727 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:07.727 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1126,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:01:08.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:07 gibba001 conmon[29242]: cluster 2021-02-11T00:01:07.496396+0000 mgr.x (mgr.14140) 724 : cluster [DBG] pgmap v555: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:08.773 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:07 gibba001 conmon[29242]: audit 2021-02-11T00:01:07.727281+0000 mon.a (mon.0) 334 : audit [DBG] from='client.? 172.21.2.101:0/1770074012' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:01:08.775 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:01:08.776 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:08.922 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:10.586 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:10.587 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:10.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:10 gibba001 conmon[29242]: cluster 2021-02-11T00:01:09.496659+0000 mgr.x (mgr.14140) 725 : cluster [DBG] pgmap v556: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:11.166 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":556,"stamp":"2021-02-11T00:01:09.496511+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575057,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:00:15 2021","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.46100000000000002,"15min":0.44900000000000001},"min":{"1min":0.36199999999999999,"5min":0.31900000000000001,"15min":0.26400000000000001},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.495,"5min":0.47999999999999998,"15min":0.46100000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.51600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738582,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:00:16 2021","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.45300000000000001,"15min":0.435},"min":{"1min":0.33200000000000002,"5min":0.29499999999999998,"15min":0.27700000000000002},"max":{"1min":0.58599999999999997,"5min":0.63600000000000001,"15min":0.64300000000000002},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.45500000000000002,"15min":0.443},"min":{"1min":0.33300000000000002,"5min":0.317,"15min":0.28699999999999998},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.439}]}]}]}} 2021-02-11T00:01:11.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:11 gibba001 conmon[29242]: audit 2021-02-11T00:01:10.586198+0000 mgr.x (mgr.14140) 726 : audit [DBG] from='client.14708 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:23.832 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:23.833 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:12 gibba001 conmon[29242]: cluster 2021-02-11T00:01:11.497183+0000 mgr.x (mgr.14140) 727 : cluster [DBG] pgmap v557: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:14 gibba001 conmon[29242]: cluster 2021-02-11T00:01:13.497921+0000 mgr.x (mgr.14140) 728 : cluster [DBG] pgmap v558: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:16 gibba001 conmon[29242]: cluster 2021-02-11T00:01:15.498659+0000 mgr.x (mgr.14140) 729 : cluster [DBG] pgmap v559: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:17 gibba001 conmon[29242]: cluster 2021-02-11T00:01:17.499369+0000 mgr.x (mgr.14140) 730 : cluster [DBG] pgmap v560: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:20 gibba001 conmon[29242]: cluster 2021-02-11T00:01:19.500119+0000 mgr.x (mgr.14140) 731 : cluster [DBG] pgmap v561: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.834 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:22 gibba001 conmon[29242]: cluster 2021-02-11T00:01:21.500874+0000 mgr.x (mgr.14140) 732 : cluster [DBG] pgmap v562: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:23.981 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:24.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:24 gibba001 conmon[29242]: cluster 2021-02-11T00:01:23.501590+0000 mgr.x (mgr.14140) 733 : cluster [DBG] pgmap v563: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:25.560 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:25.562 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:26.281 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":564,"stamp":"2021-02-11T00:01:25.501736+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575061,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.373},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.432}]}]},{"osd":0,"up_from":8,"seq":34359738585,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.40400000000000003}]}]}]}} 2021-02-11T00:01:26.282 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:01:26.428 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:26.907 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:26 gibba001 conmon[29242]: cluster 2021-02-11T00:01:25.501861+0000 mgr.x (mgr.14140) 734 : cluster [DBG] pgmap v564: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:26.907 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:26 gibba001 conmon[29242]: audit 2021-02-11T00:01:25.560463+0000 mgr.x (mgr.14140) 735 : audit [DBG] from='client.14710 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:28.005 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:30.416 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1146,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:01:30.418 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:27 gibba001 conmon[29242]: cluster 2021-02-11T00:01:27.502233+0000 mgr.x (mgr.14140) 736 : cluster [DBG] pgmap v565: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:30.418 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:28 gibba001 conmon[29242]: audit 2021-02-11T00:01:28.005372+0000 mon.a (mon.0) 335 : audit [DBG] from='client.? 172.21.2.101:0/921348484' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:01:30.418 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:29 gibba001 conmon[29242]: cluster 2021-02-11T00:01:29.502922+0000 mgr.x (mgr.14140) 737 : cluster [DBG] pgmap v566: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:30.418 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:01:30.419 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:30.565 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:32.160 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:32.162 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:32.710 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2021-02-11T00:01:31.503375+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575062,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.45900000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738586,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.38400000000000001}]}]}]}} 2021-02-11T00:01:35.836 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:32 gibba001 conmon[29242]: cluster 2021-02-11T00:01:31.503529+0000 mgr.x (mgr.14140) 738 : cluster [DBG] pgmap v567: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:35.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:33 gibba001 conmon[29242]: audit 2021-02-11T00:01:32.160478+0000 mgr.x (mgr.14140) 739 : audit [DBG] from='client.14714 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:35.837 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:34 gibba001 conmon[29242]: cluster 2021-02-11T00:01:33.504212+0000 mgr.x (mgr.14140) 740 : cluster [DBG] pgmap v568: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:36.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:36 gibba001 conmon[29242]: cluster 2021-02-11T00:01:35.504946+0000 mgr.x (mgr.14140) 741 : cluster [DBG] pgmap v569: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:38.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:37 gibba001 conmon[29242]: cluster 2021-02-11T00:01:37.505635+0000 mgr.x (mgr.14140) 742 : cluster [DBG] pgmap v570: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:40.628 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:40.774 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:40.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:40 gibba001 conmon[29242]: cluster 2021-02-11T00:01:39.506405+0000 mgr.x (mgr.14140) 743 : cluster [DBG] pgmap v571: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:42.318 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:42.319 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:42.616 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:42 gibba001 conmon[29242]: cluster 2021-02-11T00:01:41.506796+0000 mgr.x (mgr.14140) 744 : cluster [DBG] pgmap v572: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:43.323 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":572,"stamp":"2021-02-11T00:01:41.506671+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575064,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.45400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738588,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.439}]}]}]}} 2021-02-11T00:01:43.324 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:01:43.470 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:43.697 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:43 gibba001 conmon[29242]: audit 2021-02-11T00:01:42.318270+0000 mgr.x (mgr.14140) 745 : audit [DBG] from='client.14716 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:44.830 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:44 gibba001 conmon[29242]: cluster 2021-02-11T00:01:43.507060+0000 mgr.x (mgr.14140) 746 : cluster [DBG] pgmap v573: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:45.153 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:45.153 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1163,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:01:45.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:45 gibba001 conmon[29242]: audit 2021-02-11T00:01:45.154035+0000 mon.a (mon.0) 336 : audit [DBG] from='client.? 172.21.2.101:0/1606122229' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:01:45.878 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:01:45.878 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:46.022 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:46.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:46 gibba001 conmon[29242]: cluster 2021-02-11T00:01:45.507733+0000 mgr.x (mgr.14140) 747 : cluster [DBG] pgmap v574: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:46.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:46 gibba001 conmon[29242]: 2021-02-11T00:01:47.624 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:47.625 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:47.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:47 gibba001 conmon[29242]: cluster 2021-02-11T00:01:47.508014+0000 mgr.x (mgr.14140) 748 : cluster [DBG] pgmap v575: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:47.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:47 gibba001 conmon[29242]: audit 2021-02-11T00:01:47.624418+0000 mgr.x (mgr.14140) 749 : audit [DBG] from='client.14720 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:48.323 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":575,"stamp":"2021-02-11T00:01:47.507880+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575065,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.51100000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738590,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.40899999999999997}]}]}]}} 2021-02-11T00:01:50.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:50 gibba001 conmon[29242]: cluster 2021-02-11T00:01:49.508693+0000 mgr.x (mgr.14140) 750 : cluster [DBG] pgmap v576: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:51.325 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:01:51.469 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:52.831 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:52 gibba001 conmon[29242]: cluster 2021-02-11T00:01:51.508961+0000 mgr.x (mgr.14140) 751 : cluster [DBG] pgmap v577: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:57.041 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:01:57.041 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":577,"stamp":"2021-02-11T00:01:51.508837+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575066,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.47499999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738590,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.40899999999999997}]}]}]}} 2021-02-11T00:01:57.041 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:01:57.042 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:01:53 gibba001 conmon[29628]: debug 2021-02-11T00:01:53.273+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-11T00:01:57.042 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:01:57.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:53 gibba001 conmon[29242]: audit 2021-02-11T00:01:53.388595+0000 mon.a (mon.0) 337 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-11T00:01:57.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:53 gibba001 conmon[29242]: audit 2021-02-11T00:01:53.388713+0000 mon.a (mon.0) 338 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-11T00:01:57.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:54 gibba001 conmon[29242]: audit 2021-02-11T00:01:53.092244+0000 mgr.x (mgr.14140) 752 : audit [DBG] from='client.14722 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:01:57.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:54 gibba001 conmon[29242]: cluster 2021-02-11T00:01:53.509264+0000 mgr.x (mgr.14140) 753 : cluster [DBG] pgmap v578: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:57.043 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:56 gibba001 conmon[29242]: cluster 2021-02-11T00:01:55.509579+0000 mgr.x (mgr.14140) 754 : cluster [DBG] pgmap v579: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:01:57.187 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:01:58.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:57 gibba001 conmon[29242]: cluster 2021-02-11T00:01:57.510107+0000 mgr.x (mgr.14140) 755 : cluster [DBG] pgmap v580: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:01.031 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:01.031 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1177,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:02:01.032 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:58 gibba001 conmon[29242]: audit 2021-02-11T00:01:58.859796+0000 mon.a (mon.0) 339 : audit [DBG] from='client.? 172.21.2.101:0/3921347872' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:02:01.032 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:01:59 gibba001 conmon[29242]: cluster 2021-02-11T00:01:59.510771+0000 mgr.x (mgr.14140) 756 : cluster [DBG] pgmap v581: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:01.032 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:02:01.032 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:01.178 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:02.735 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:03.708 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:02:03.708 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:02 gibba001 conmon[29242]: cluster 2021-02-11T00:02:01.511177+0000 mgr.x (mgr.14140) 757 : cluster [DBG] pgmap v582: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:03.708 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":582,"stamp":"2021-02-11T00:02:01.511049+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575068,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.56899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738592,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.376},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.434}]}]}]}} 2021-02-11T00:02:03.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:03 gibba001 conmon[29242]: audit 2021-02-11T00:02:02.734765+0000 mgr.x (mgr.14140) 758 : audit [DBG] from='client.14726 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:02:04.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:04 gibba001 conmon[29242]: cluster 2021-02-11T00:02:03.511860+0000 mgr.x (mgr.14140) 759 : cluster [DBG] pgmap v583: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:06.710 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:06.856 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:06.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:06 gibba001 conmon[29242]: cluster 2021-02-11T00:02:05.512356+0000 mgr.x (mgr.14140) 760 : cluster [DBG] pgmap v584: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.903 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:07 gibba001 conmon[29242]: cluster 2021-02-11T00:02:07.512600+0000 mgr.x (mgr.14140) 761 : cluster [DBG] pgmap v585: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.903 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:08 gibba001 conmon[29242]: audit 2021-02-11T00:02:08.428709+0000 mgr.x (mgr.14140) 762 : audit [DBG] from='client.14728 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:02:17.903 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:09 gibba001 conmon[29242]: cluster 2021-02-11T00:02:09.513298+0000 mgr.x (mgr.14140) 763 : cluster [DBG] pgmap v586: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.903 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:12 gibba001 conmon[29242]: cluster 2021-02-11T00:02:11.513749+0000 mgr.x (mgr.14140) 764 : cluster [DBG] pgmap v587: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.904 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:14 gibba001 conmon[29242]: cluster 2021-02-11T00:02:13.514451+0000 mgr.x (mgr.14140) 765 : cluster [DBG] pgmap v588: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.904 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:16 gibba001 conmon[29242]: cluster 2021-02-11T00:02:15.514817+0000 mgr.x (mgr.14140) 766 : cluster [DBG] pgmap v589: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:17.904 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:17.904 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":585,"stamp":"2021-02-11T00:02:07.512473+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575069,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:01:19 2021","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.47499999999999998,"15min":0.45500000000000002},"min":{"1min":0.33400000000000002,"5min":0.33000000000000002,"15min":0.26400000000000001},"max":{"1min":0.625,"5min":0.63700000000000001,"15min":0.70099999999999996},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.48799999999999999,"15min":0.46300000000000002},"min":{"1min":0.312,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.627,"5min":0.66200000000000003,"15min":0.68600000000000005},"last":0.38600000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738594,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:01:16 2021","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.46899999999999997,"15min":0.441},"min":{"1min":0.373,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48799999999999999,"5min":0.46300000000000002,"15min":0.44700000000000001},"min":{"1min":0.41999999999999998,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.58699999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.52500000000000002}]}]}]}} 2021-02-11T00:02:17.904 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:02:17.905 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:02:18.050 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:18.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:17 gibba001 conmon[29242]: cluster 2021-02-11T00:02:17.515528+0000 mgr.x (mgr.14140) 767 : cluster [DBG] pgmap v590: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:19.779 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:29.571 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1198,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:20 gibba001 conmon[29242]: cluster 2021-02-11T00:02:19.515791+0000 mgr.x (mgr.14140) 768 : cluster [DBG] pgmap v591: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:20 gibba001 conmon[29242]: audit 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:20 gibba001 conmon[29242]: 2021-02-11T00:02:19.779642+0000 mon.a (mon.0) 340 : audit [DBG] from='client.? 172.21.2.101:0/269238041' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:22 gibba001 conmon[29242]: cluster 2021-02-11T00:02:21.516293+0000 mgr.x (mgr.14140) 769 : cluster [DBG] pgmap v592: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:24 gibba001 conmon[29242]: cluster 2021-02-11T00:02:23.516998+0000 mgr.x (mgr.14140) 770 : cluster [DBG] pgmap v593: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:26 gibba001 conmon[29242]: cluster 2021-02-11T00:02:25.517740+0000 mgr.x (mgr.14140) 771 : cluster [DBG] pgmap v594: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:29.573 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:27 gibba001 conmon[29242]: cluster 2021-02-11T00:02:27.518466+0000 mgr.x (mgr.14140) 772 : cluster [DBG] pgmap v595: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:29.574 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:02:29.574 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:29.719 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:30.886 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:30 gibba001 conmon[29242]: cluster 2021-02-11T00:02:29.519074+0000 mgr.x (mgr.14140) 773 : cluster [DBG] pgmap v596: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:31.335 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:31.336 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:02:31.976 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":596,"stamp":"2021-02-11T00:02:29.518963+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575073,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48799999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738598,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:02:19 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.50600000000000001}]}]}]}} 2021-02-11T00:02:32.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:32 gibba001 conmon[29242]: audit 2021-02-11T00:02:31.334774+0000 mgr.x (mgr.14140) 774 : audit [DBG] from='client.14732 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:02:32.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:32 gibba001 conmon[29242]: cluster 2021-02-11T00:02:31.519423+0000 mgr.x (mgr.14140) 775 : cluster [DBG] pgmap v597: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:34.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:34 gibba001 conmon[29242]: cluster 2021-02-11T00:02:33.520148+0000 mgr.x (mgr.14140) 776 : cluster [DBG] pgmap v598: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:38.846 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:38.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:36 gibba001 conmon[29242]: cluster 2021-02-11T00:02:35.520602+0000 mgr.x (mgr.14140) 777 : cluster [DBG] pgmap v599: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:38.847 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:37 gibba001 conmon[29242]: cluster 2021-02-11T00:02:37.521254+0000 mgr.x (mgr.14140) 778 : cluster [DBG] pgmap v600: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:39.002 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:40.661 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:40.661 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:02:40.900 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:40 gibba001 conmon[29242]: cluster 2021-02-11T00:02:39.521547+0000 mgr.x (mgr.14140) 779 : cluster [DBG] pgmap v601: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:41.308 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":601,"stamp":"2021-02-11T00:02:39.521428+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575075,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.40000000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738600,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:02:19 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.46300000000000002}]}]}]}} 2021-02-11T00:02:41.309 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:02:41.459 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:41.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:41 gibba001 conmon[29242]: audit 2021-02-11T00:02:40.660308+0000 mgr.x (mgr.14140) 780 : audit [DBG] from='client.14734 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:02:42.839 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:42 gibba001 conmon[29242]: cluster 2021-02-11T00:02:41.521877+0000 mgr.x (mgr.14140) 781 : cluster [DBG] pgmap v602: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:43.128 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:48.597 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1221,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:02:48.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:43 gibba001 conmon[29242]: audit 2021-02-11T00:02:43.127734+0000 mon.a (mon.0) 341 : audit [DBG] from='client.? 172.21.2.101:0/4131836103' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:02:48.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:44 gibba001 conmon[29242]: cluster 2021-02-11T00:02:43.522475+0000 mgr.x (mgr.14140) 782 : cluster [DBG] pgmap v603: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:48.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:46 gibba001 conmon[29242]: cluster 2021-02-11T00:02:45.522938+0000 mgr.x (mgr.14140) 783 : cluster [DBG] pgmap v604: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:48.598 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:47 gibba001 conmon[29242]: cluster 2021-02-11T00:02:47.523406+0000 mgr.x (mgr.14140) 784 : cluster [DBG] pgmap v605: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:48.599 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:02:48.599 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:48.770 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:02:50.411 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:02:50.412 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:02:50.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:50 gibba001 conmon[29242]: cluster 2021-02-11T00:02:49.523800+0000 mgr.x (mgr.14140) 785 : cluster [DBG] pgmap v606: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:51.068 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":606,"stamp":"2021-02-11T00:02:49.523688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575077,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.77800000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738602,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:02:19 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.49299999999999999}]}]}]}} 2021-02-11T00:02:51.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:51 gibba001 conmon[29242]: audit 2021-02-11T00:02:50.410674+0000 mgr.x (mgr.14140) 786 : audit [DBG] from='client.14738 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:02:52.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:52 gibba001 conmon[29242]: cluster 2021-02-11T00:02:51.524259+0000 mgr.x (mgr.14140) 787 : cluster [DBG] pgmap v607: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:53.711 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:02:53 gibba001 conmon[29628]: debug 2021-02-11T00:02:53.274+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-11T00:02:59.288 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:54 gibba001 conmon[29242]: audit 2021-02-11T00:02:53.348037+0000 mon.a (mon.0) 342 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:54 gibba001 conmon[29242]: audit 2021-02-11T00:02:53.390595+0000 mon.a (mon. 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:54 gibba001 conmon[29242]: 0) 343 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:54 gibba001 conmon[29242]: audit 2021-02-11T00:02:53.390727+0000 mon.a (mon.0) 344 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:54 gibba001 conmon[29242]: cluster 2021-02-11T00:02:53.524646+0000 mgr.x (mgr.14140) 788 : cluster [DBG] pgmap v608: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:56 gibba001 conmon[29242]: cluster 2021-02-11T00:02:55.525223+0000 mgr.x (mgr.14140) 789 : cluster [DBG] pgmap v609: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:59.289 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:02:57 gibba001 conmon[29242]: cluster 2021-02-11T00:02:57.525518+0000 mgr.x (mgr.14140) 790 : cluster [DBG] pgmap v610: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:02:59.438 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:00.854 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:00 gibba001 conmon[29242]: cluster 2021-02-11T00:02:59.525787+0000 mgr.x (mgr.14140) 791 : cluster [DBG] pgmap v611: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.382 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:12.382 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":611,"stamp":"2021-02-11T00:02:59.525676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575079,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55300000000000005}]}]},{"osd":0,"up_from":8,"seq":34359738604,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:02:19 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.46200000000000002}]}]}]}} 2021-02-11T00:03:12.383 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:03:12.383 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:02 gibba001 conmon[29242]: audit 2021-02-11T00:03:01.059955+0000 mgr.x (mgr.14140) 792 : audit [DBG] from='client.14740 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:02 gibba001 conmon[29242]: cluster 2021-02-11T00:03:01.526258+0000 mgr.x (mgr.14140) 793 : cluster [DBG] pgmap v612: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:04 gibba001 conmon[29242]: cluster 2021-02-11T00:03:03.526955+0000 mgr.x (mgr.14140) 794 : cluster [DBG] pgmap v613: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:06 gibba001 conmon[29242]: cluster 2021-02-11T00:03:05.527645+0000 mgr.x (mgr.14140) 795 : cluster [DBG] pgmap v614: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:07 gibba001 conmon[29242]: cluster 2021-02-11T00:03:07.528375+0000 mgr.x (mgr.14140) 796 : cluster [DBG] pgmap v615: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.384 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:10 gibba001 conmon[29242]: cluster 2021-02-11T00:03:09.528969+0000 mgr.x (mgr.14140) 797 : cluster [DBG] pgmap v616: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:12.529 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:12.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:12 gibba001 conmon[29242]: cluster 2021-02-11T00:03:11.529387+0000 mgr.x (mgr.14140) 798 : cluster [DBG] pgmap v617: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:14.226 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:15.258 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1252,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:03:15.260 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:14 gibba001 conmon[29242]: cluster 2021-02-11T00:03:13.529929+0000 mgr.x (mgr.14140) 799 : cluster [DBG] pgmap v618: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:15.260 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:14 gibba001 conmon[29242]: audit 2021-02-11T00:03:14.226588+0000 mon.a (mon.0) 345 : audit [DBG] from='client.? 172.21.2.101:0/1955543323' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:03:15.260 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:03:15.260 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:03:15.408 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:16.854 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:16 gibba001 conmon[29242]: cluster 2021-02-11T00:03:15.530329+0000 mgr.x (mgr.14140) 800 : cluster [DBG] pgmap v619: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:17.061 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:17.063 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:03:17.675 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":619,"stamp":"2021-02-11T00:03:15.530204+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575083,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42199999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738607,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:02:19 2021","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46700000000000003,"15min":0.44400000000000001},"min":{"1min":0.32400000000000001,"5min":0.29599999999999999,"15min":0.28000000000000003},"max":{"1min":0.59999999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.45900000000000002,"15min":0.44800000000000001},"min":{"1min":0.33800000000000002,"5min":0.317,"15min":0.30299999999999999},"max":{"1min":0.64300000000000002,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.54100000000000004}]}]}]}} 2021-02-11T00:03:17.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:17 gibba001 conmon[29242]: audit 2021-02-11T00:03:17.061475+0000 mgr.x (mgr.14140) 801 : audit [DBG] from='client.14744 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:03:17.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:17 gibba001 conmon[29242]: cluster 2021-02-11T00:03:17.530756+0000 mgr.x (mgr.14140) 802 : cluster [DBG] pgmap v620: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:20.677 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:03:22.395 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:20 gibba001 conmon[29242]: cluster 2021-02-11T00:03:19.531484+0000 mgr.x (mgr.14140) 803 : cluster [DBG] pgmap v621: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:22.541 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:22.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:22 gibba001 conmon[29242]: cluster 2021-02-11T00:03:21.532038+0000 mgr.x (mgr.14140) 804 : cluster [DBG] pgmap v622: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:24.210 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:33.446 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:03:33.447 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":623,"stamp":"2021-02-11T00:03:23.532479+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575084,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:02:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.48299999999999998,"15min":0.45800000000000002},"min":{"1min":0.36399999999999999,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.436},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.48999999999999999,"15min":0.46899999999999997},"min":{"1min":0.38600000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51200000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738609,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.48099999999999998}]}]}]}} 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:24 gibba001 conmon[29242]: cluster 2021-02-11T00:03:23.532597+0000 mgr.x (mgr.14140) 805 : cluster [DBG] pgmap v623: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:25 gibba001 conmon[29242]: audit 2021-02-11T00:03:24.209829+0000 mgr.x (mgr.14140) 806 : audit [DBG] from='client.14746 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:26 gibba001 conmon[29242]: cluster 2021-02-11T00:03:25.533284+0000 mgr.x (mgr.14140) 807 : cluster [DBG] pgmap v624: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:27 gibba001 conmon[29242]: cluster 2021-02-11T00:03:27.533828+0000 mgr.x (mgr.14140) 808 : cluster [DBG] pgmap v625: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:30 gibba001 conmon[29242]: cluster 2021-02-11T00:03:29.534575+0000 mgr.x (mgr.14140) 809 : cluster [DBG] pgmap v626: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:33.447 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:32 gibba001 conmon[29242]: cluster 2021-02-11T00:03:31.535019+0000 mgr.x (mgr.14140) 810 : cluster [DBG] pgmap v627: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:33.448 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:03:33.593 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:34.948 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:34 gibba001 conmon[29242]: cluster 2021-02-11T00:03:33.535293+0000 mgr.x (mgr.14140) 811 : cluster [DBG] pgmap v628: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:35.244 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:35.244 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1273,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:03:35.827 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:03:37.624 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:03:37.625 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:35 gibba001 conmon[29242]: audit 2021-02-11T00:03:35.244722+0000 mon.a (mon.0) 346 : audit [DBG] from='client.? 172.21.2.101:0/1420215268' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:03:37.626 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:36 gibba001 conmon[29242]: cluster 2021-02-11T00:03:35.536035+0000 mgr.x (mgr.14140) 812 : cluster [DBG] pgmap v629: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:37.769 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:37.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:37 gibba001 conmon[29242]: cluster 2021-02-11T00:03:37.536670+0000 mgr.x (mgr.14140) 813 : cluster [DBG] pgmap v630: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:49.573 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:49.574 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":630,"stamp":"2021-02-11T00:03:37.536506+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575087,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:03:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.46200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.47299999999999998},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.436}]}]},{"osd":0,"up_from":8,"seq":34359738612,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.59399999999999997}]}]}]}} 2021-02-11T00:03:49.574 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:40 gibba001 conmon[29242]: audit 2021-02-11T00:03:39.427854+0000 mgr.x (mgr.14140) 814 : audit [DBG] from='client.14750 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:40 gibba001 conmon[29242]: cluster 2021-02-11T00:03:39.536955+0000 mgr.x (mgr.14140) 815 : cluster [DBG] pgmap v631: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:42 gibba001 conmon[29242]: cluster 2021-02-11T00:03:41.537599+0000 mgr.x (mgr.14140) 816 : cluster [DBG] pgmap v632: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:44 gibba001 conmon[29242]: cluster 2021-02-11T00:03:43.538490+0000 mgr.x (mgr.14140) 817 : cluster [DBG] pgmap v633: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:46 gibba001 conmon[29242]: cluster 2021-02-11T00:03:45.538825+0000 mgr.x (mgr.14140) 818 : cluster [DBG] pgmap v634: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:49.575 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:47 gibba001 conmon[29242]: cluster 2021-02-11T00:03:47.539539+0000 mgr.x (mgr.14140) 819 : cluster [DBG] pgmap v635: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:50.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:50 gibba001 conmon[29242]: cluster 2021-02-11T00:03:49.540013+0000 mgr.x (mgr.14140) 820 : cluster [DBG] pgmap v636: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:50.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:50 gibba001 conmon[29242]: audit 2021-02-11T00:03:50.250806+0000 mon.a (mon.0) 347 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-11T00:03:50.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:50 gibba001 conmon[29242]: audit 2021-02-11T00:03:50.251523+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-02-11T00:03:52.461 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:52 gibba001 conmon[29242]: audit 2021-02-11T00:03:51.091984+0000 mon.a (mon.0) 349 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-11T00:03:52.461 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:52 gibba001 conmon[29242]: cephadm 2021-02-11T00:03:51.092357+0000 mgr.x (mgr.14140) 821 : cephadm [INF] Refreshing gibba001 facts 2021-02-11T00:03:52.461 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:52 gibba001 conmon[29242]: audit 2021-02-11T00:03:51.325673+0000 mon.a (mon.0) 350 : audit 2021-02-11T00:03:52.461 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:52 gibba001 conmon[29242]: [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' 2021-02-11T00:03:52.461 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:52 gibba001 conmon[29242]: cluster 2021-02-11T00:03:51.540615+0000 mgr.x (mgr.14140) 822 : cluster [DBG] pgmap v637: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:52.575 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:03:52.720 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:53.443 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:03:53 gibba001 conmon[29628]: debug 2021-02-11T00:03:53.275+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-11T00:03:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:53 gibba001 conmon[29242]: audit 2021-02-11T00:03:53.392696+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-11T00:03:53.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:53 gibba001 conmon[29242]: audit 2021-02-11T00:03:53.392895+0000 mon.a (mon.0) 352 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-11T00:03:54.227 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:54.228 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:03:54.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:54 gibba001 conmon[29242]: cluster 2021-02-11T00:03:53.541199+0000 mgr.x (mgr.14140) 823 : cluster [DBG] pgmap v638: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:54.936 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":638,"stamp":"2021-02-11T00:03:53.541072+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575090,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:03:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.46200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.441},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.47299999999999998},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738615,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.37},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.48499999999999999}]}]}]}} 2021-02-11T00:03:54.937 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:03:55.081 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:55.579 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:55 gibba001 conmon[29242]: audit 2021-02-11T00:03:54.226542+0000 mgr.x (mgr.14140) 824 : audit [DBG] from='client.14752 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:03:56.660 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:03:56.660 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1295,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:03:56.710 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:56 gibba001 conmon[29242]: cluster 2021-02-11T00:03:55.541735+0000 mgr.x (mgr.14140) 825 : cluster [DBG] 2021-02-11T00:03:56.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:56 gibba001 conmon[29242]: pgmap v639: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:03:57.336 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:03:57.336 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:03:57.484 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:03:57.697 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:57 gibba001 conmon[29242]: audit 2021-02-11T00:03:56.660946+0000 mon.a (mon.0) 353 : audit [DBG] from='client.? 172.21.2.101:0/223868626' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:04:07.234 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:03:58 gibba001 conmon[29242]: cluster 2021-02-11T00:03:57.542187+0000 mgr.x (mgr.14140) 826 : cluster [DBG] pgmap v640: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:00 gibba001 conmon[29242]: audit 2021-02-11T00:03:59.084762+0000 mgr.x (mgr.14140) 827 : audit [DBG] from='client.14756 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:00 gibba001 conmon[29242]: cluster 2021-02-11T00:03:59. 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:00 gibba001 conmon[29242]: 542775+0000 mgr.x (mgr.14140) 828 : cluster [DBG] pgmap v641: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:02 gibba001 conmon[29242]: cluster 2021-02-11T00:04:01.543352+0000 mgr.x (mgr.14140) 829 : cluster [DBG] pgmap v642: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:04 gibba001 conmon[29242]: cluster 2021-02-11T00:04:03.544013+0000 mgr.x (mgr.14140) 830 : cluster [DBG] pgmap v643: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:07.235 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:06 gibba001 conmon[29242]: cluster 2021-02-11T00:04:05.544645+0000 mgr.x (mgr.14140) 831 : cluster [DBG] pgmap v644: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:07.235 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:07.236 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":640,"stamp":"2021-02-11T00:03:57.542066+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575091,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:03:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.46200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.47299999999999998},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46400000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738616,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.48999999999999999}]}]}]}} 2021-02-11T00:04:07.236 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:04:08.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:07 gibba001 conmon[29242]: cluster 2021-02-11T00:04:07.545390+0000 mgr.x (mgr.14140) 832 : cluster [DBG] pgmap v645: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:10.237 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:04:10.384 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:10.941 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:10 gibba001 conmon[29242]: cluster 2021-02-11T00:04:09.545766+0000 mgr.x (mgr.14140) 833 : cluster [DBG] pgmap v646: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:11.958 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:11.959 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:04:12.601 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":647,"stamp":"2021-02-11T00:04:11.545910+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575094,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:03:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.46200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.47299999999999998},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.49399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738618,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.5}]}]}]}} 2021-02-11T00:04:12.602 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:04:12.750 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:12.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:12 gibba001 conmon[29242]: cluster 2021-02-11T00:04:11.546052+0000 mgr.x (mgr.14140) 834 : cluster [DBG] pgmap v647: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:13.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:13 gibba001 conmon[29242]: audit 2021-02-11T00:04:11.957840+0000 mgr.x (mgr.14140) 835 : audit [DBG] from='client.14758 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:04:14.504 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:14.504 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1312,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:04:14.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:14 gibba001 conmon[29242]: cluster 2021-02-11T00:04:13.546477+0000 mgr.x (mgr.14140) 836 : cluster [DBG] pgmap v648: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:14.961 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:14 gibba001 conmon[29242]: audit 2021-02-11T00:04:14.504738+0000 mon.a (mon.0) 354 : audit [DBG] from='client.? 172.21.2.101:0/2320200345' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:04:15.336 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:04:15.336 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:04:15.480 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:16.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:16 gibba001 conmon[29242]: cluster 2021-02-11T00:04:15.546887+0000 mgr.x (mgr.14140) 837 : cluster [DBG] pgmap v649: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:16.991 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:16.992 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:04:17.618 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":649,"stamp":"2021-02-11T00:04:15.546765+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575095,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:03:22 2021","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48599999999999999,"15min":0.46200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.71799999999999997,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.501,"15min":0.47299999999999998},"min":{"1min":0.40000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.77800000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.44400000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738619,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.442},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.56299999999999994}]}]}]}} 2021-02-11T00:04:18.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:17 gibba001 conmon[29242]: audit 2021-02-11T00:04:16.991084+0000 mgr.x (mgr.14140) 838 : audit [DBG] from='client.14762 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:04:18.211 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:17 gibba001 conmon[29242]: cluster 2021-02-11T00:04:17.547542+0000 mgr.x (mgr.14140) 839 : cluster [DBG] pgmap v650: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:20.619 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:04:24.819 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:20 gibba001 conmon[29242]: cluster 2021-02-11T00:04:19.547829+0000 mgr.x (mgr.14140) 840 : cluster [DBG] pgmap v651: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:24.820 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:22 gibba001 conmon[29242]: cluster 2021-02-11T00:04:21.548242+0000 mgr.x (mgr.14140) 841 : cluster [DBG] pgmap v652: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:24.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:24 gibba001 conmon[29242]: cluster 2021-02-11T00:04:23.548974+0000 mgr.x (mgr.14140) 842 : cluster [DBG] pgmap v653: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:24.965 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:26.546 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:26.547 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:04:26.960 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:26 gibba001 conmon[29242]: cluster 2021-02-11T00:04:25.549310+0000 mgr.x (mgr.14140) 843 : cluster [DBG] pgmap v654: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:27.183 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":654,"stamp":"2021-02-11T00:04:25.549171+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575097,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:04:23 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.626,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.379,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59399999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.51000000000000001}]}]},{"osd":0,"up_from":8,"seq":34359738621,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:03:21 2021","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47299999999999998,"15min":0.44900000000000001},"min":{"1min":0.36299999999999999,"5min":0.29599999999999999,"15min":0.28999999999999998},"max":{"1min":0.59799999999999998,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.45400000000000001},"min":{"1min":0.40699999999999997,"5min":0.317,"15min":0.317},"max":{"1min":0.59699999999999998,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.48899999999999999}]}]}]}} 2021-02-11T00:04:27.184 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph status --format=json 2021-02-11T00:04:27.330 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:27.842 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:27 gibba001 conmon[29242]: audit 2021-02-11T00:04:26.545796+0000 mgr.x (mgr.14140) 844 : audit [DBG] from='client.14764 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:04:28.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:28 gibba001 conmon[29242]: cluster 2021-02-11T00:04:27.549972+0000 mgr.x (mgr.14140) 845 : cluster [DBG] pgmap v655: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:28.970 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:04:28.970 INFO:teuthology.orchestra.run.gibba001.stdout:{"fsid":"7788ccb8-6bf9-11eb-8fef-001a4aab830c","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 8 pgs undersized","count":8},"muted":false}},"mutes":[]},"election_epoch":5,"quorum":[0],"quorum_names":["a"],"quorum_age":1327,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":1},"osdmap":{"epoch":18,"num_osds":2,"num_up_osds":2,"osd_up_since":1613000629,"num_in_osds":2,"osd_in_since":1613000629,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+undersized","count":8}],"num_pgs":8,"num_pools":1,"num_objects":0,"data_bytes":0,"bytes_used":10158080,"bytes_avail":180378468352,"bytes_total":180388626432},"fsmap":{"epoch":1,"by_rank":[],"up:standby":0},"mgrmap":{"available":true,"num_standbys":0,"modules":["cephadm","dashboard","iostat","restful"],"services":{"dashboard":"https://gibba001:8443/"}},"servicemap":{"epoch":7,"modified":"2021-02-10T23:59:51.475832+0000","services":{}},"progress_events":{}} 2021-02-11T00:04:29.698 INFO:tasks.cephadm.ceph_manager.ceph:no progress seen, keeping timeout for now 2021-02-11T00:04:58.001 INFO:tasks.cephadm.ceph_manager.ceph:dumping pgs not clean 2021-02-11T00:04:58.002 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:83d3ac1b03b4de4360f18a023c40ea1ae6fc3928 shell --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c -- ceph pg dump --format=json 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:29 gibba001 conmon[29242]: audit 2021-02-11T00:04:28.970539+0000 mon.a (mon.0) 355 : audit [DBG] from='client.? 172.21.2.101:0/3466432049' entity='client.admin' cmd=[{"prefix": "status", "format": "json"}]: dispatch 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:30 gibba001 conmon[29242]: cluster 2021-02-11T00:04:29.550536+0000 mgr.x (mgr.14140) 846 : cluster [DBG] pgmap v656: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:32 gibba001 conmon[29242]: cluster 2021-02-11T00:04:31.551075+0000 mgr.x (mgr.14140) 847 : cluster [DBG] pgmap v657: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:34 gibba001 conmon[29242]: cluster 2021-02-11T00:04:33.551431+0000 mgr.x (mgr.14140) 848 : cluster [DBG] pgmap v658: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:36 gibba001 conmon[29242]: cluster 2021-02-11T00:04:35.552177+0000 mgr.x (mgr.14140) 849 : cluster [DBG] pgmap v659: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:37 gibba001 conmon[29242]: cluster 2021-02-11T00:04:37.552790+0000 mgr.x (mgr.14140) 850 : cluster [DBG] pgmap v660: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:40 gibba001 conmon[29242]: cluster 2021-02-11T00:04:39.553519+0000 mgr.x (mgr.14140) 851 : cluster [DBG] pgmap v661: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:42 gibba001 conmon[29242]: cluster 2021-02-11T00:04:41.554131+0000 mgr.x (mgr.14140) 852 : cluster [DBG] pgmap v662: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:44 gibba001 conmon[29242]: cluster 2021-02-11T00:04:43.554486+0000 mgr.x (mgr.14140) 853 : cluster [DBG] pgmap v663: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.005 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:46 gibba001 conmon[29242]: cluster 2021-02-11T00:04:45.554895+0000 mgr.x (mgr.14140) 854 : cluster [DBG] pgmap v664: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:47 gibba001 conmon[29242]: cluster 2021-02-11T00:04:47.555668+0000 mgr.x (mgr.14140) 855 : cluster [DBG] pgmap v665: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:50 gibba001 conmon[29242]: cluster 2021-02-11T00:04:49.556342+0000 mgr.x (mgr.14140) 856 : cluster [DBG] pgmap v666: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:52 gibba001 conmon[29242]: cluster 2021-02-11T00:04:51.557031+0000 mgr.x (mgr.14140) 857 : cluster [DBG] pgmap v667: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:53 gibba001 conmon[29242]: audit 2021-02-11T00:04:53.394975+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:53 gibba001 conmon[29242]: audit 2021-02-11T00:04:53.395272+0000 mon.a (mon.0) 357 : audit [INF] from='mgr.14140 172.21.2.101:0/7' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:54 gibba001 conmon[29242]: cluster 2021-02-11T00:04:53.557710+0000 mgr.x (mgr.14140) 858 : cluster [DBG] pgmap v668: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:56 gibba001 conmon[29242]: cluster 2021-02-11T00:04:55.558447+0000 mgr.x (mgr.14140) 859 : cluster [DBG] pgmap v669: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:58.006 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:04:53 gibba001 conmon[29628]: debug 2021-02-11T00:04:53.276+0000 7f070fe8e700 -1 calc_pg_upmaps abort due to max <= 0 2021-02-11T00:04:58.154 INFO:teuthology.orchestra.run.gibba001.stderr:Inferring config /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/mon.a/config 2021-02-11T00:04:58.210 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:04:57 gibba001 conmon[29242]: cluster 2021-02-11T00:04:57.559162+0000 mgr.x (mgr.14140) 860 : cluster [DBG] pgmap v670: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:04:59.769 INFO:teuthology.orchestra.run.gibba001.stdout: 2021-02-11T00:05:31.995 INFO:teuthology.orchestra.run.gibba001.stderr:dumped all 2021-02-11T00:05:31.996 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":671,"stamp":"2021-02-11T00:04:59.559367+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":2,"num_per_pool_osds":2,"num_per_pool_omap_osds":2,"kb":176160768,"kb_used":9920,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":9600,"kb_avail":176150848,"statfs":{"total":180388626432,"available":180378468352,"internally_reserved":0,"allocated":311296,"data_stored":78452,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":9830400},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318544+0000","last_change":"2021-02-10T23:43:57.318412+0000","last_active":"2021-02-10T23:43:58.318544+0000","last_peered":"2021-02-10T23:43:58.318544+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318412+0000","last_became_peered":"2021-02-10T23:43:57.318412+0000","last_unstale":"2021-02-10T23:43:58.318544+0000","last_undegraded":"2021-02-10T23:43:58.318544+0000","last_fullsized":"2021-02-10T23:43:57.315917+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318582+0000","last_change":"2021-02-10T23:43:57.318354+0000","last_active":"2021-02-10T23:43:58.318582+0000","last_peered":"2021-02-10T23:43:58.318582+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318354+0000","last_became_peered":"2021-02-10T23:43:57.318354+0000","last_unstale":"2021-02-10T23:43:58.318582+0000","last_undegraded":"2021-02-10T23:43:58.318582+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367321+0000","last_change":"2021-02-10T23:43:57.317877+0000","last_active":"2021-02-10T23:43:58.367321+0000","last_peered":"2021-02-10T23:43:58.367321+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.317877+0000","last_became_peered":"2021-02-10T23:43:57.317877+0000","last_unstale":"2021-02-10T23:43:58.367321+0000","last_undegraded":"2021-02-10T23:43:58.367321+0000","last_fullsized":"2021-02-10T23:43:57.316635+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318521+0000","last_change":"2021-02-10T23:43:57.318305+0000","last_active":"2021-02-10T23:43:58.318521+0000","last_peered":"2021-02-10T23:43:58.318521+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318305+0000","last_became_peered":"2021-02-10T23:43:57.318305+0000","last_unstale":"2021-02-10T23:43:58.318521+0000","last_undegraded":"2021-02-10T23:43:58.318521+0000","last_fullsized":"2021-02-10T23:43:57.315872+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.367330+0000","last_change":"2021-02-10T23:43:57.319464+0000","last_active":"2021-02-10T23:43:58.367330+0000","last_peered":"2021-02-10T23:43:58.367330+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.319464+0000","last_became_peered":"2021-02-10T23:43:57.319464+0000","last_unstale":"2021-02-10T23:43:58.367330+0000","last_undegraded":"2021-02-10T23:43:58.367330+0000","last_fullsized":"2021-02-10T23:43:57.316666+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":["0","1"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318560+0000","last_change":"2021-02-10T23:43:57.318279+0000","last_active":"2021-02-10T23:43:58.318560+0000","last_peered":"2021-02-10T23:43:58.318560+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318279+0000","last_became_peered":"2021-02-10T23:43:57.318279+0000","last_unstale":"2021-02-10T23:43:58.318560+0000","last_undegraded":"2021-02-10T23:43:58.318560+0000","last_fullsized":"2021-02-10T23:43:57.315868+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318531+0000","last_change":"2021-02-10T23:43:57.318525+0000","last_active":"2021-02-10T23:43:58.318531+0000","last_peered":"2021-02-10T23:43:58.318531+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318525+0000","last_became_peered":"2021-02-10T23:43:57.318525+0000","last_unstale":"2021-02-10T23:43:58.318531+0000","last_undegraded":"2021-02-10T23:43:58.318531+0000","last_fullsized":"2021-02-10T23:43:57.315879+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"8","reported_epoch":"17","state":"active+undersized","last_fresh":"2021-02-10T23:43:58.318540+0000","last_change":"2021-02-10T23:43:57.318132+0000","last_active":"2021-02-10T23:43:58.318540+0000","last_peered":"2021-02-10T23:43:58.318540+0000","last_clean":"2021-02-10T23:43:56.310657+0000","last_became_active":"2021-02-10T23:43:57.318132+0000","last_became_peered":"2021-02-10T23:43:57.318132+0000","last_unstale":"2021-02-10T23:43:58.318540+0000","last_undegraded":"2021-02-10T23:43:58.318540+0000","last_fullsized":"2021-02-10T23:43:57.315888+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-10T23:43:56.310657+0000","last_clean_scrub_stamp":"2021-02-10T23:43:56.310657+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":["1","0"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":2}],"osd_stats":[{"osd":1,"up_from":13,"seq":55834575103,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 11 00:04:23 2021","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48999999999999999,"15min":0.46400000000000002},"min":{"1min":0.38500000000000001,"5min":0.33400000000000002,"15min":0.29799999999999999},"max":{"1min":0.626,"5min":0.72799999999999998,"15min":0.72799999999999998},"last":0.438},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.501,"15min":0.47499999999999998},"min":{"1min":0.379,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59399999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.47599999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738628,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":88080384,"kb_used":4960,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":88075424,"statfs":{"total":90194313216,"available":90189234176,"internally_reserved":0,"allocated":155648,"data_stored":39226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 11 00:04:26 2021","interfaces":[{"interface":"back","average":{"1min":0.42599999999999999,"5min":0.46500000000000002,"15min":0.45100000000000001},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.28999999999999998},"max":{"1min":0.56200000000000006,"5min":0.63700000000000001,"15min":0.64300000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.501,"5min":0.47699999999999998,"15min":0.45800000000000002},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.317},"max":{"1min":0.59399999999999997,"5min":0.66600000000000004,"15min":0.69399999999999995},"last":0.53000000000000003}]}]}]}} 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:00 gibba001 conmon[29242]: cluster 2021-02-11T00:04:59.559482+0000 mgr.x (mgr.14140) 861 : cluster [DBG] pgmap v671: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:00 gibba001 conmon[29242]: audit 2021-02-11T00:04:59.768727+0000 mgr.x (mgr.14140) 862 : audit [DBG] from='client.14768 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:02 gibba001 conmon[29242]: cluster 2021-02-11T00:05:01.560172+0000 mgr.x (mgr.14140) 863 : cluster [DBG] pgmap v672: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:04 gibba001 conmon[29242]: cluster 2021-02-11T00:05:03.560861+0000 mgr.x (mgr.14140) 864 : cluster [DBG] pgmap v673: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:06 gibba001 conmon[29242]: cluster 2021-02-11T00:05:05.561603+0000 mgr.x (mgr.14140) 865 : cluster [DBG] pgmap v674: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:07 gibba001 conmon[29242]: cluster 2021-02-11T00:05:07.562361+0000 mgr.x (mgr.14140) 866 : cluster [DBG] pgmap v675: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:10 gibba001 conmon[29242]: cluster 2021-02-11T00:05:09.563092+0000 mgr.x (mgr.14140) 867 : cluster [DBG] pgmap v676: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:12 gibba001 conmon[29242]: cluster 2021-02-11T00:05:11.563624+0000 mgr.x (mgr.14140) 868 : cluster [DBG] pgmap v677: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.996 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:14 gibba001 conmon[29242]: cluster 2021-02-11T00:05:13.564104+0000 mgr.x (mgr.14140) 869 : cluster [DBG] pgmap v678: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:16 gibba001 conmon[29242]: cluster 2021-02-11T00:05:15.564812+0000 mgr.x (mgr.14140) 870 : cluster [DBG] pgmap v679: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:17 gibba001 conmon[29242]: cluster 2021-02-11T00:05:17.565499+0000 mgr.x (mgr.14140) 871 : cluster [DBG] pgmap v680: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:20 gibba001 conmon[29242]: cluster 2021-02-11T00:05:19.566263+0000 mgr.x (mgr.14140) 872 : cluster [DBG] pgmap v681: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:22 gibba001 conmon[29242]: cluster 2021-02-11T00:05:21.566880+0000 mgr.x (mgr.14140) 873 : cluster [DBG] pgmap v682: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:24 gibba001 conmon[29242]: cluster 2021-02-11T00:05:23.567547+0000 mgr.x (mgr.14140) 874 : cluster [DBG] pgmap v683: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:26 gibba001 conmon[29242]: cluster 2021-02-11T00:05:25.568307+0000 mgr.x (mgr.14140) 875 : cluster [DBG] pgmap v684: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:27 gibba001 conmon[29242]: cluster 2021-02-11T00:05:27.568882+0000 mgr.x (mgr.14140) 876 : cluster [DBG] pgmap v685: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.997 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:30 gibba001 conmon[29242]: cluster 2021-02-11T00:05:29.569561+0000 mgr.x (mgr.14140) 877 : cluster [DBG] pgmap v686: 8 pgs: 8 active+undersized; 0 B data, 9.7 MiB used, 168 GiB / 168 GiB avail 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.7 is not active+clean 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.7', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318544+0000', 'last_change': '2021-02-10T23:43:57.318412+0000', 'last_active': '2021-02-10T23:43:58.318544+0000', 'last_peered': '2021-02-10T23:43:58.318544+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318412+0000', 'last_became_peered': '2021-02-10T23:43:57.318412+0000', 'last_unstale': '2021-02-10T23:43:58.318544+0000', 'last_undegraded': '2021-02-10T23:43:58.318544+0000', 'last_fullsized': '2021-02-10T23:43:57.315917+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.6 is not active+clean 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.6', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318582+0000', 'last_change': '2021-02-10T23:43:57.318354+0000', 'last_active': '2021-02-10T23:43:58.318582+0000', 'last_peered': '2021-02-10T23:43:58.318582+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318354+0000', 'last_became_peered': '2021-02-10T23:43:57.318354+0000', 'last_unstale': '2021-02-10T23:43:58.318582+0000', 'last_undegraded': '2021-02-10T23:43:58.318582+0000', 'last_fullsized': '2021-02-10T23:43:57.315888+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.1 is not active+clean 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.1', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.367321+0000', 'last_change': '2021-02-10T23:43:57.317877+0000', 'last_active': '2021-02-10T23:43:58.367321+0000', 'last_peered': '2021-02-10T23:43:58.367321+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.317877+0000', 'last_became_peered': '2021-02-10T23:43:57.317877+0000', 'last_unstale': '2021-02-10T23:43:58.367321+0000', 'last_undegraded': '2021-02-10T23:43:58.367321+0000', 'last_fullsized': '2021-02-10T23:43:57.316635+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.0 is not active+clean 2021-02-11T00:05:31.998 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.0', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318521+0000', 'last_change': '2021-02-10T23:43:57.318305+0000', 'last_active': '2021-02-10T23:43:58.318521+0000', 'last_peered': '2021-02-10T23:43:58.318521+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318305+0000', 'last_became_peered': '2021-02-10T23:43:57.318305+0000', 'last_unstale': '2021-02-10T23:43:58.318521+0000', 'last_undegraded': '2021-02-10T23:43:58.318521+0000', 'last_fullsized': '2021-02-10T23:43:57.315872+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.2 is not active+clean 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.2', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.367330+0000', 'last_change': '2021-02-10T23:43:57.319464+0000', 'last_active': '2021-02-10T23:43:58.367330+0000', 'last_peered': '2021-02-10T23:43:58.367330+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.319464+0000', 'last_became_peered': '2021-02-10T23:43:57.319464+0000', 'last_unstale': '2021-02-10T23:43:58.367330+0000', 'last_undegraded': '2021-02-10T23:43:58.367330+0000', 'last_fullsized': '2021-02-10T23:43:57.316666+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': ['0', '1'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.3 is not active+clean 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.3', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318560+0000', 'last_change': '2021-02-10T23:43:57.318279+0000', 'last_active': '2021-02-10T23:43:58.318560+0000', 'last_peered': '2021-02-10T23:43:58.318560+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318279+0000', 'last_became_peered': '2021-02-10T23:43:57.318279+0000', 'last_unstale': '2021-02-10T23:43:58.318560+0000', 'last_undegraded': '2021-02-10T23:43:58.318560+0000', 'last_fullsized': '2021-02-10T23:43:57.315868+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.4 is not active+clean 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.4', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318531+0000', 'last_change': '2021-02-10T23:43:57.318525+0000', 'last_active': '2021-02-10T23:43:58.318531+0000', 'last_peered': '2021-02-10T23:43:58.318531+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318525+0000', 'last_became_peered': '2021-02-10T23:43:57.318525+0000', 'last_unstale': '2021-02-10T23:43:58.318531+0000', 'last_undegraded': '2021-02-10T23:43:58.318531+0000', 'last_fullsized': '2021-02-10T23:43:57.315879+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:PG 1.5 is not active+clean 2021-02-11T00:05:31.999 INFO:tasks.cephadm.ceph_manager.ceph:{'pgid': '1.5', 'version': "0'0", 'reported_seq': '8', 'reported_epoch': '17', 'state': 'active+undersized', 'last_fresh': '2021-02-10T23:43:58.318540+0000', 'last_change': '2021-02-10T23:43:57.318132+0000', 'last_active': '2021-02-10T23:43:58.318540+0000', 'last_peered': '2021-02-10T23:43:58.318540+0000', 'last_clean': '2021-02-10T23:43:56.310657+0000', 'last_became_active': '2021-02-10T23:43:57.318132+0000', 'last_became_peered': '2021-02-10T23:43:57.318132+0000', 'last_unstale': '2021-02-10T23:43:58.318540+0000', 'last_undegraded': '2021-02-10T23:43:58.318540+0000', 'last_fullsized': '2021-02-10T23:43:57.315888+0000', 'mapping_epoch': 15, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 15, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'last_clean_scrub_stamp': '2021-02-10T23:43:56.310657+0000', 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': ['1', '0'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2021-02-11T00:05:31.999 INFO:tasks.cephadm:Teardown begin 2021-02-11T00:05:31.999 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/contextutil.py", line 33, in nested yield vars File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/cephadm.py", line 1261, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph.py", line 1443, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph_manager.py", line 2500, in wait_for_clean 'wait_for_clean: failed before timeout expired' AssertionError: wait_for_clean: failed before timeout expired 2021-02-11T00:05:32.003 DEBUG:teuthology.orchestra.run.gibba001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-02-11T00:05:32.031 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2021-02-11T00:05:32.031 DEBUG:teuthology.orchestra.run.gibba001:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2021-02-11T00:05:32.082 INFO:tasks.cephadm:Stopping all daemons... 2021-02-11T00:05:32.083 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2021-02-11T00:05:32.083 DEBUG:teuthology.orchestra.run.gibba001:> sudo systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a 2021-02-11T00:05:32.434 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:32 gibba001 systemd[1]: Stopping Ceph mon.a for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-11T00:05:32.434 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:32 gibba001 conmon[29242]: debug 2021-02-11T00:05:32.197+0000 7fc986c24700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2021-02-11T00:05:32.434 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:32 gibba001 conmon[29242]: debug 2021-02-11T00:05:32.197+0000 7fc986c24700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-02-11T00:05:32.711 INFO:journalctl@ceph.mon.a.gibba001.stdout:Feb 11 00:05:32 gibba001 podman[134364]: 574b0d4224dd54e61626af90bfb69fc64459652f521555de90314f64d0db04c3 2021-02-11T00:05:32.818 DEBUG:teuthology.orchestra.run.gibba001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mon.a.service' 2021-02-11T00:05:32.847 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-02-11T00:05:32.847 INFO:tasks.cephadm.mon.a:Stopped mon.a 2021-02-11T00:05:32.847 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2021-02-11T00:05:32.847 DEBUG:teuthology.orchestra.run.gibba001:> sudo systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x 2021-02-11T00:05:33.192 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:05:32 gibba001 systemd[1]: Stopping Ceph mgr.x for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-11T00:05:33.192 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:05:32 gibba001 conmon[29628]: debug 2021-02-11T00:05:33.461 INFO:journalctl@ceph.mgr.x.gibba001.stdout:Feb 11 00:05:33 gibba001 podman[134504]: d6b007ab412c0db4b6d97e1c43c06223d7e9a2ec8276aa44b151c256a26fd612 2021-02-11T00:05:33.581 DEBUG:teuthology.orchestra.run.gibba001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@mgr.x.service' 2021-02-11T00:05:33.608 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-02-11T00:05:33.608 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2021-02-11T00:05:33.609 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2021-02-11T00:05:33.609 DEBUG:teuthology.orchestra.run.gibba001:> sudo systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.0 2021-02-11T00:05:33.951 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 11 00:05:33 gibba001 systemd[1]: Stopping Ceph osd.0 for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-11T00:05:33.951 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 11 00:05:33 gibba001 conmon[39157]: debug 2021-02-11T00:05:33.709+0000 7f7405e63700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-02-11T00:05:33.951 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 11 00:05:33 gibba001 conmon[39157]: debug 2021-02-11T00:05:33.709+0000 7f7405e63700 -1 osd.0 18 *** Got signal Terminated *** 2021-02-11T00:05:33.951 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 11 00:05:33 gibba001 conmon[39157]: debug 2021-02-11T00:05:33.709+0000 7f7405e63700 -1 osd.0 18 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-02-11T00:05:34.210 INFO:journalctl@ceph.osd.0.gibba001.stdout:Feb 11 00:05:34 gibba001 podman[134652]: 19eb385db7a1f1731023b81b52f1b34d3a1126680f3727da182c621c02079b7b 2021-02-11T00:05:35.356 DEBUG:teuthology.orchestra.run.gibba001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.0.service' 2021-02-11T00:05:35.383 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-02-11T00:05:35.384 INFO:tasks.cephadm.osd.0:Stopped osd.0 2021-02-11T00:05:35.384 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2021-02-11T00:05:35.384 DEBUG:teuthology.orchestra.run.gibba001:> sudo systemctl stop ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.1 2021-02-11T00:05:35.711 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 11 00:05:35 gibba001 systemd[1]: Stopping Ceph osd.1 for 7788ccb8-6bf9-11eb-8fef-001a4aab830c... 2021-02-11T00:05:35.711 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 11 00:05:35 gibba001 conmon[43594]: debug 2021-02-11T00:05:35.487+0000 7f0f6abdc700 -1 received signal: Terminated from /dev/init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2021-02-11T00:05:35.711 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 11 00:05:35 gibba001 conmon[43594]: debug 2021-02-11T00:05:35.487+0000 7f0f6abdc700 -1 osd.1 18 *** Got signal Terminated *** 2021-02-11T00:05:35.711 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 11 00:05:35 gibba001 conmon[43594]: debug 2021-02-11T00:05:35.487+0000 7f0f6abdc700 -1 osd.1 18 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-02-11T00:05:36.067 INFO:journalctl@ceph.osd.1.gibba001.stdout:Feb 11 00:05:35 gibba001 podman[135006]: a75aa172ab5df424da446810aa9e33c3331a4af2b21d15d740cb3fa8e61bf7d2 2021-02-11T00:05:37.109 DEBUG:teuthology.orchestra.run.gibba001:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7788ccb8-6bf9-11eb-8fef-001a4aab830c@osd.1.service' 2021-02-11T00:05:37.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2021-02-11T00:05:37.137 INFO:tasks.cephadm.osd.1:Stopped osd.1 2021-02-11T00:05:37.137 DEBUG:teuthology.orchestra.run.gibba001:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2021-02-11T00:05:37.195 INFO:tasks.cephadm:Archiving crash dumps... 2021-02-11T00:05:37.197 DEBUG:teuthology.misc:Transferring archived files from gibba001:/var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/crash to /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961/remote/ubuntu@gibba001.front.sepia.ceph.com/crash 2021-02-11T00:05:37.197 DEBUG:teuthology.orchestra.run.gibba001:> sudo tar cz -f - -C /var/lib/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/crash -- . 2021-02-11T00:05:37.265 INFO:tasks.cephadm:Checking cluster log for badness... 2021-02-11T00:05:37.265 DEBUG:teuthology.orchestra.run.gibba001:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2021-02-11T00:05:37.324 INFO:teuthology.orchestra.run.gibba001.stderr:grep: /var/log/ceph/7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph.log: No such file or directory 2021-02-11T00:05:37.325 INFO:tasks.cephadm:Compressing logs... 2021-02-11T00:05:37.325 DEBUG:teuthology.orchestra.run.gibba001:> sudo find /var/log/ceph -name *.log -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-11T00:05:37.368 INFO:tasks.cephadm:Archiving logs... 2021-02-11T00:05:37.368 DEBUG:teuthology.misc:Transferring archived files from gibba001:/var/log/ceph to /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961/remote/ubuntu@gibba001.front.sepia.ceph.com/log 2021-02-11T00:05:37.369 DEBUG:teuthology.orchestra.run.gibba001:> sudo tar cz -f - -C /var/log/ceph -- . 2021-02-11T00:05:37.776 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph-osd.1.log: file changed as we read it 2021-02-11T00:05:37.938 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph-mgr.x.log: file changed as we read it 2021-02-11T00:05:38.003 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph-volume.log: File removed before we read it 2021-02-11T00:05:38.309 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph-mon.a.log: file changed as we read it 2021-02-11T00:05:38.671 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c/ceph-osd.0.log: file changed as we read it 2021-02-11T00:05:38.672 INFO:teuthology.orchestra.run.gibba001.stderr:tar: ./7788ccb8-6bf9-11eb-8fef-001a4aab830c: file changed as we read it 2021-02-11T00:05:38.685 INFO:tasks.cephadm:Removing cluster... 2021-02-11T00:05:38.685 DEBUG:teuthology.orchestra.run.gibba001:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7788ccb8-6bf9-11eb-8fef-001a4aab830c --force 2021-02-11T00:05:39.229 INFO:tasks.cephadm:Removing cephadm ... 2021-02-11T00:05:39.229 DEBUG:teuthology.orchestra.run.gibba001:> rm -rf /home/ubuntu/cephtest/cephadm 2021-02-11T00:05:39.240 INFO:tasks.cephadm:Teardown complete 2021-02-11T00:05:39.240 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/cephadm.py", line 1261, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph.py", line 1443, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph_manager.py", line 2500, in wait_for_clean 'wait_for_clean: failed before timeout expired' AssertionError: wait_for_clean: failed before timeout expired 2021-02-11T00:05:39.389 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=d49d77a5103c4021ae3a82b52ffde459 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/run_tasks.py", line 94, in run_tasks manager.__enter__() File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/cephadm.py", line 1261, in task healthy(ctx=ctx, config=config) File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph.py", line 1443, in healthy manager.wait_for_clean() File "/home/teuthworker/src/github.com_harishmunjulur_ceph_d2ee8f1c2f76677a4f3bb21611881adb033d0c00/qa/tasks/ceph_manager.py", line 2500, in wait_for_clean 'wait_for_clean: failed before timeout expired' AssertionError: wait_for_clean: failed before timeout expired 2021-02-11T00:05:39.391 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2021-02-11T00:05:39.397 DEBUG:teuthology.run_tasks:Unwinding manager install 2021-02-11T00:05:40.897 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits... 2021-02-11T00:05:40.898 DEBUG:teuthology.orchestra.run.gibba001:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits 2021-02-11T00:05:40.939 DEBUG:teuthology.run_tasks:Unwinding manager clock 2021-02-11T00:05:41.994 INFO:teuthology.task.clock:Checking final clock skew... 2021-02-11T00:05:41.994 DEBUG:teuthology.orchestra.run.gibba001:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-02-11T00:05:42.006 INFO:teuthology.orchestra.run.gibba001.stderr:bash: ntpq: command not found 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:210 Number of sources = 4 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:=============================================================================== 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:^- hv01.front.sepia.ceph.com 3 6 377 19 -4050us[-4050us] +/- 96ms 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:^* hv02.front.sepia.ceph.com 2 8 377 81 +370us[ +387us] +/- 45ms 2021-02-11T00:05:42.011 INFO:teuthology.orchestra.run.gibba001.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 19 -494us[ -494us] +/- 65ms 2021-02-11T00:05:42.012 INFO:teuthology.orchestra.run.gibba001.stdout:^+ hv04.front.sepia.ceph.com 3 6 377 20 -40us[ -40us] +/- 52ms 2021-02-11T00:05:42.012 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2021-02-11T00:05:42.944 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2021-02-11T00:05:42.944 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2021-02-11T00:05:44.324 DEBUG:teuthology.orchestra.run.gibba001:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2021-02-11T00:05:44.371 DEBUG:teuthology.orchestra.run.gibba001:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-02-11T00:05:44.391 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-11T00:05:44.392 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2021-02-11T00:05:44.630 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2021-02-11T00:05:45.284 INFO:teuthology.task.internal:Duration was 1912.328366 seconds 2021-02-11T00:05:45.285 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2021-02-11T00:05:46.261 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2021-02-11T00:05:46.262 DEBUG:teuthology.orchestra.run.gibba001:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2021-02-11T00:05:46.297 INFO:teuthology.orchestra.run.gibba001.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-02-11T00:05:46.721 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2021-02-11T00:05:46.721 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba001.front.sepia.ceph.com 2021-02-11T00:05:46.722 DEBUG:teuthology.orchestra.run.gibba001:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-11T00:05:46.777 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2021-02-11T00:05:46.777 DEBUG:teuthology.orchestra.run.gibba001:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2021-02-11T00:05:46.861 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2021-02-11T00:05:47.170 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2021-02-11T00:05:47.170 DEBUG:teuthology.orchestra.run.gibba001:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2021-02-11T00:05:47.191 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2021-02-11T00:05:48.788 DEBUG:teuthology.orchestra.run.gibba001:> sudo sysctl -w kernel.core_pattern=core && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2021-02-11T00:05:57.549 INFO:teuthology.orchestra.run.gibba001.stdout:kernel.core_pattern = core 2021-02-11T00:05:57.551 DEBUG:teuthology.orchestra.run.gibba001:> test -e /home/ubuntu/cephtest/archive/coredump 2021-02-11T00:05:57.603 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-02-11T00:05:57.603 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2021-02-11T00:05:57.615 INFO:teuthology.task.internal:Transferring archived files... 2021-02-11T00:05:57.615 DEBUG:teuthology.misc:Transferring archived files from gibba001:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/hmunjulu-2021-02-09_00:33:45-rbd:singleton-master-distro-basic-gibba/5868961/remote/gibba001 2021-02-11T00:05:57.616 DEBUG:teuthology.orchestra.run.gibba001:> sudo tar cz -f - -C /home/ubuntu/cephtest/archive -- . 2021-02-11T00:05:57.680 INFO:teuthology.task.internal:Removing archive directory... 2021-02-11T00:05:57.681 DEBUG:teuthology.orchestra.run.gibba001:> rm -rf -- /home/ubuntu/cephtest/archive 2021-02-11T00:05:57.727 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2021-02-11T00:05:58.398 INFO:teuthology.task.internal:Not uploading archives. 2021-02-11T00:05:58.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2021-02-11T00:06:00.077 INFO:teuthology.task.internal:Tidying up after the test... 2021-02-11T00:06:00.077 DEBUG:teuthology.orchestra.run.gibba001:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2021-02-11T00:06:00.089 INFO:teuthology.orchestra.run.gibba001.stdout: 262163 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Feb 11 00:05 /home/ubuntu/cephtest 2021-02-11T00:06:00.091 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2021-02-11T00:06:02.295 INFO:teuthology.nuke:Checking targets against current locks 2021-02-11T00:06:02.403 CRITICAL:teuthology:Uncaught exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/virtualenv/bin/teuthology", line 33, in sys.exit(load_entry_point('teuthology', 'console_scripts', 'teuthology')()) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/scripts/run.py", line 38, in main teuthology.run.main(args) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/run.py", line 412, in main report_outcome(config, archive, fake_ctx.summary, fake_ctx) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/run.py", line 269, in report_outcome nuke(fake_ctx, fake_ctx.lock) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/nuke/__init__.py", line 266, in nuke for unnuked in p: File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/nuke/__init__.py", line 280, in nuke_one keep_logs = ctx.keep_logs File "/home/teuthworker/src/git.ceph.com_git_teuthology_14fad31725ce3e5fc27890f2a8ef1f21c838d296/teuthology/config.py", line 255, in __getattr__ raise AttributeError(name) AttributeError: keep_logs